Jul 11 01:06:17.008510 ip-10-0-139-236 systemd[1]: Starting Kubernetes Kubelet...
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.397689    2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404687    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404703    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404707    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404710    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404713    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404716    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404719    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:17.455942 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404722    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404725    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404728    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404730    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404734    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404736    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404739    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404741    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404744    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404746    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404749    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404751    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404754    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404757    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404764    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404766    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404769    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404772    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404775    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:17.457640 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404779    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404783    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404786    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404788    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404792    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404795    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404798    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404801    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404804    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404807    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404810    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404813    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404817    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404820    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404823    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404825    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404828    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404831    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404833    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404836    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:17.458465 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404840    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404842    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404845    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404849    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404852    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404855    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404858    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404861    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404863    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404866    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404868    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404871    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404873    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404876    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404878    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404881    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404884    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404886    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404888    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:17.465917 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404892    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404895    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404898    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404901    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404904    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404906    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404910    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404913    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404915    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404918    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404920    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404923    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404925    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404928    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404931    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404933    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404936    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404938    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404942    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404945    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:17.466865 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404949    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404952    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404955    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404958    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404960    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404963    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404965    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404968    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404970    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404973    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404977    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404981    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404985    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.404989    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405729    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405735    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405738    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405741    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405744    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405747    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:17.468732 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405750    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:17.467944 ip-10-0-139-236 systemd[1]: Started Kubernetes Kubelet.
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405752    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405755    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405758    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405760    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405763    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405765    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405768    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405772    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405774    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405777    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405781    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405784    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405787    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405789    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405792    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405794    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405797    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405799    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:17.469577 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405803    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405805    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405808    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405811    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405813    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405816    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405819    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405821    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405825    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405829    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405832    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405834    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405837    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405839    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405843    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405846    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405849    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405853    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405857    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405860    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:17.470858 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405863    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405866    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405869    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405872    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405875    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405879    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405882    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405885    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405887    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405890    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405893    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405895    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405898    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405901    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405903    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405906    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405908    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405911    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405914    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405916    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:17.580709 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405919    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405921    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405924    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405927    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405932    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405936    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405939    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405942    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405945    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405947    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405950    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405952    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405955    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405958    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405960    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405963    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405965    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405968    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405977    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405980    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:17.581754 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405983    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405985    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405988    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405990    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405993    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405996    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.405998    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406001    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406004    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406006    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406009    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406012    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406014    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406017    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406414    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406420    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406423    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406425    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406428    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406431    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:17.582975 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406433    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406436    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406438    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406441    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406446    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406449    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406452    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406454    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406457    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406460    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406463    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406466    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406469    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406471    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406474    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406476    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406479    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406481    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406484    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:17.585424 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406486    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406489    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406491    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406493    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406496    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406498    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406501    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406503    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406506    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406509    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406511    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406514    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406518    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406520    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406523    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406526    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406528    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406532    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406534    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406537    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:17.586221 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406539    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406542    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406544    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406546    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406549    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406552    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406554    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406558    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406561    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406563    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406565    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406570    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406573    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406575    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406578    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406580    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406583    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406586    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406588    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:17.587021 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406590    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406593    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406595    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406598    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406600    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406604    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406606    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406609    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406611    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406614    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406618    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406620    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406622    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406625    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406628    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406631    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406633    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406635    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406639    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406641    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:17.589833 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406644    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406646    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406649    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406652    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406654    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406656    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406659    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406664    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406667    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406670    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406673    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406676    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406679    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406682    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.406684    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406766    2555 flags.go:64] FLAG: --address="0.0.0.0"
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406776    2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406808    2555 flags.go:64] FLAG: --anonymous-auth="true"
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406813    2555 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406818    2555 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406821    2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 11 01:06:17.591013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406825    2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406831    2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406834    2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406837    2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406841    2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406844    2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406848    2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406851    2555 flags.go:64] FLAG: --cgroup-root=""
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406853    2555 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406857    2555 flags.go:64] FLAG: --client-ca-file=""
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406860    2555 flags.go:64] FLAG: --cloud-provider="external"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406863    2555 flags.go:64] FLAG: --cluster-dns="[]"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406867    2555 flags.go:64] FLAG: --cluster-domain=""
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406870    2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406874    2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406877    2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406881    2555 flags.go:64] FLAG: --container-log-max-files="5"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406884    2555 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406887    2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406890    2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406894    2555 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406896    2555 flags.go:64] FLAG: --contention-profiling="false"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406899    2555 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406902    2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 11 01:06:17.593424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406906    2555 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406909    2555 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406913    2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406916    2555 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406920    2555 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406923    2555 flags.go:64] FLAG: --enable-load-reader="false"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406926    2555 flags.go:64] FLAG: --enable-server="true"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406929    2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406934    2555 flags.go:64] FLAG: --event-burst="100"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406938    2555 flags.go:64] FLAG: --event-qps="50"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406941    2555 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406944    2555 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406947    2555 flags.go:64] FLAG: --eviction-hard=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406951    2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406954    2555 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406956    2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406959    2555 flags.go:64] FLAG: --eviction-soft=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406962    2555 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406965    2555 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406969    2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406972    2555 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406975    2555 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406978    2555 flags.go:64] FLAG: --fail-swap-on="true"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406981    2555 flags.go:64] FLAG: --feature-gates=""
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406984    2555 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 11 01:06:17.594625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406987    2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406990    2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406993    2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406997    2555 flags.go:64] FLAG: --healthz-port="10248"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.406999    2555 flags.go:64] FLAG: --help="false"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407002    2555 flags.go:64] FLAG: --hostname-override="ip-10-0-139-236.ec2.internal"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407005    2555 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407008    2555 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407011    2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407014    2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407018    2555 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407022    2555 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407025    2555 flags.go:64] FLAG: --image-service-endpoint=""
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407028    2555 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407030    2555 flags.go:64] FLAG: --kube-api-burst="100"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407033    2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407037    2555 flags.go:64] FLAG: --kube-api-qps="50"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407040    2555 flags.go:64] FLAG: --kube-reserved=""
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407043    2555 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407046    2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407049    2555 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407051    2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407054    2555 flags.go:64] FLAG: --lock-file=""
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407057    2555 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 11 01:06:17.597019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407060    2555 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407062    2555 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407068    2555 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407072    2555 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407074    2555 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407077    2555 flags.go:64] FLAG: --logging-format="text"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407080    2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407083    2555 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407086    2555 flags.go:64] FLAG: --manifest-url=""
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407088    2555 flags.go:64] FLAG: --manifest-url-header=""
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407092    2555 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407095    2555 flags.go:64] FLAG: --max-open-files="1000000"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407099    2555 flags.go:64] FLAG: --max-pods="110"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407102    2555 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407105    2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407108    2555 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407110    2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407113    2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407116    2555 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407120    2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407128    2555 flags.go:64] FLAG: --node-status-max-images="50"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407131    2555 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407134    2555 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 11 01:06:17.598192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407137    2555 flags.go:64] FLAG: --pod-cidr=""
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407142    2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407148    2555 flags.go:64] FLAG: --pod-manifest-path=""
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407150    2555 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407154    2555 flags.go:64] FLAG: --pods-per-core="0"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407157    2555 flags.go:64] FLAG: --port="10250"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407160    2555 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407163    2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0be59d97bcb5b2a56"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407166    2555 flags.go:64] FLAG: --qos-reserved=""
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407169    2555 flags.go:64] FLAG: --read-only-port="10255"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407172    2555 flags.go:64] FLAG: --register-node="true"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407175    2555 flags.go:64] FLAG: --register-with-taints=""
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407178    2555 flags.go:64] FLAG: --registry-burst="10"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407182    2555 flags.go:64] FLAG: --registry-qps="5"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407185    2555 flags.go:64] FLAG: --reserved-cpus=""
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407187    2555 flags.go:64] FLAG: --reserved-memory=""
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407191    2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407194    2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407211    2555 flags.go:64] FLAG: --rotate-certificates="false"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407215    2555 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407218    2555 flags.go:64] FLAG: --runonce="false"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407221    2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407224    2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407227    2555 flags.go:64] FLAG: --seccomp-default="false"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407230    2555 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 11 01:06:17.599778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407233    2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407235    2555 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407238    2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407243    2555 flags.go:64] FLAG: --storage-driver-password="root"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407246    2555 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407248    2555 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407251    2555 flags.go:64] FLAG: --storage-driver-user="root"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407254    2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407257    2555 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407261    2555 flags.go:64] FLAG: --system-cgroups=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407264    2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407269    2555 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407272    2555 flags.go:64] FLAG: --tls-cert-file=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407275    2555 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407279    2555 flags.go:64] FLAG: --tls-min-version=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407282    2555 flags.go:64] FLAG: --tls-private-key-file=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407284    2555 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407287    2555 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407290    2555 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407293    2555 flags.go:64] FLAG: --v="2"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407297    2555 flags.go:64] FLAG: --version="false"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407302    2555 flags.go:64] FLAG: --vmodule=""
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407306    2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.407309    2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407427    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:17.600963 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407431    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407434    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407437    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407441    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407443    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407446    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407449    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407451    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407454    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407457    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407461    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407464    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407466    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407469    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407471    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407473    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407478    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407480    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407483    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407485    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:17.602190 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407488    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407490    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407493    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407495    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407498    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407501    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407503    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407506    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407508    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407514    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407517    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407519    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407521    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407524    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407526    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407529    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407531    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407534    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407536    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:17.603376 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407539    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407542    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407544    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407548    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407550    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407553    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407555    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407558    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407560    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407564    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407566    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407569    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407573    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407576    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407579    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407582    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407585    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407588    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407592    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:17.604186 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407594    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407597    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407599    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407601    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407605    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407607    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407610    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407612    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407615    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407617    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407620    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407622    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407625    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407627    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407629    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407632    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407636    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407639    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407641    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407644    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:17.604970 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407646    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407649    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407652    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407655    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407657    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407660    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407663    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407665    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407668    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407670    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407673    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407676    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407678    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407682    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407685    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407688    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407691    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407694    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407697    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:17.605804 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.407700    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.408513    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.415521    2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.415538    2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.415554    2555 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.415569    2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415643    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415648    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415651    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415655    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415658    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415661    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415665    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415667    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415670    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:17.606582 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415673    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415676    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415679    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415681    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415684    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415687    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415689    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415692    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415696    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415700    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415703    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415706    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415709    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415712    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415715    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415725    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415728    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415732    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415734    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:17.607387 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415737    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415739    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415742    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415745    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415747    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415750    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415752    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415755    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415757    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415760    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415762    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415765    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415769    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415772    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415775    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415777    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415780    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415782    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415785    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:17.608178 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415787    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415790    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415792    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415795    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415797    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415799    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415802    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415804    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415809    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415811    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415820    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415823    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415825    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415828    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415831    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415833    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415836    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415838    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415841    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415844    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:17.610160 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415846    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415849    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415853    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415856    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415859    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415862    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415865    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415867    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415870    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415873    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415875    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415884    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415887    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415890    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415892    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415895    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415898    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415900    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415903    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:17.610964 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415905    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415909    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415911    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415916    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415924    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415927    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415930    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415932    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415935    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415937    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415940    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415942    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.415945    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.415950    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416089    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 11 01:06:17.613379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416093    2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416096    2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416099    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416102    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416104    2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416116    2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416119    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416122    2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416124    2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416127    2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416129    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416131    2555 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416134    2555 feature_gate.go:328] unrecognized feature gate: Example2
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416137    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416139    2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416142    2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416144    2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416147    2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416151    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416154    2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 11 01:06:17.614188 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416156    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416160    2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416169    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416172    2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416174    2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416177    2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416179    2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416182    2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416184    2555 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416187    2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416190    2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416192    2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416195    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416210    2555 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416215    2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416218    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416220    2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416222    2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416225    2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416228    2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 11 01:06:17.712191 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416230    2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416232    2555 feature_gate.go:328] unrecognized feature gate: Example
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416235    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416238    2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416240    2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416242    2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416245    2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416248    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416250    2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416253    2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416257    2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416259    2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416262    2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416265    2555 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416268    2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416277    2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416280    2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416282    2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416285    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416289    2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 11 01:06:17.713314 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416292    2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416296    2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416299    2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416302    2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416305    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416308    2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416310    2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416313    2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416315    2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416318    2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416321    2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416325    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416327    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416330    2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416332    2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416335    2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416337    2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416340    2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416343    2555 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 11 01:06:17.714067 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416345    2555 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416348    2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416350    2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416354    2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416356    2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416359    2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416363    2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416365    2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416368    2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416376    2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416379    2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416381    2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416384    2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416387    2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416389    2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416392    2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416395    2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416397    2555 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 11 01:06:17.714862 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:17.416400    2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.416405    2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.416502    2555 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.420072    2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.421510    2555 server.go:1019] "Starting client certificate rotation"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.421607    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.421639    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.423849    2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.427660    2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.437418    2555 log.go:25] "Validated CRI v1 runtime API"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.439988    2555 log.go:25] "Validated CRI v1 image API"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.440885    2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 11 01:06:17.715646 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.443927    2555 fs.go:135] Filesystem UUIDs: map[483ddd59-015c-4c1c-a502-9ccd6fa238c5:/dev/nvme0n1p3 6a8d7db4-ddb3-44cc-aec7-5d794839215e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 11 01:06:17.717645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.443945    2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 11 01:06:17.717645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.447760    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.449714    2555 manager.go:216] Machine: {Timestamp:2026-07-11 01:06:17.448559217 +0000 UTC m=+0.315527757 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095638 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287c6de2bd5c145ec2ad30106f8e94 SystemUUID:ec287c6d-e2bd-5c14-5ec2-ad30106f8e94 BootID:c0f065ec-249f-4351-9a4d-dc4bc3cfbff4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:2a:17:14:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:2a:17:14:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:67:64:02:73:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.449819    2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.449903    2555 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.450954    2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.450975    2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.451642    2555 topology_manager.go:138] "Creating topology manager with none policy"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.451651    2555 container_manager_linux.go:309] "Creating device plugin manager"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.451659    2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.452338    2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.453141    2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456092    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456230    2555 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456256    2555 kubelet.go:486] "Attempting to sync node with API server"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456265    2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456275    2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456310    2555 kubelet.go:398] "Adding apiserver pod source"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456319    2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 11 01:06:17.718461 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456685    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.456701    2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.458808    2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.460832    2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.460874    2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461511    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461529    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461539    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461547    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461561    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461569    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461581    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461590    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461600    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461608    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461620    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.461635    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.462787    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.462798    2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.466847    2555 server.go:1268] "Started kubelet"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.466952    2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.467116    2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.467189    2555 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.467858    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.467893    2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.468029    2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.471789    2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.472741    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwm67"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.472924    2555 server.go:310] "Adding debug handlers to kubelet server"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.473862    2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.476031    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwm67"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.475590    2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-236.ec2.internal.18c116c86b69c299  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-236.ec2.internal,UID:ip-10-0-139-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-236.ec2.internal,},FirstTimestamp:2026-07-11 01:06:17.466790553 +0000 UTC m=+0.333759096,LastTimestamp:2026-07-11 01:06:17.466790553 +0000 UTC m=+0.333759096,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-236.ec2.internal,}"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.481752    2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.481764    2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.481821    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482320    2555 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482336    2555 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482441    2555 reconstruct.go:97] "Volume reconstruction finished"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482449    2555 reconciler.go:29] "Reconciler: start to sync state"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482602    2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 11 01:06:17.719261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482820    2555 factory.go:55] Registering systemd factory
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.482837    2555 factory.go:223] Registration of the systemd container factory successfully
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.483066    2555 factory.go:153] Registering CRI-O factory
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.483084    2555 factory.go:223] Registration of the crio container factory successfully
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.483134    2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.483156    2555 factory.go:103] Registering Raw factory
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.483171    2555 manager.go:1196] Started watching for new ooms in manager
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.484067    2555 manager.go:349] Starting recovery of all containers
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.495004    2555 manager.go:354] Recovery completed
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.500463    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503268    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503304    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503321    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503887    2555 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503897    2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503918    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.503924    2555 state_mem.go:36] "Initialized new in-memory state store"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.504737    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.504761    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.504778    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.505655    2555 policy_none.go:49] "None policy: Start"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.505681    2555 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.505700    2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:17.506734    2555 policy_none.go:47] "Start"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.582658    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:17.722070 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.682863    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:17.832378 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.783104    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:17.949153 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.883384    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.066789 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:17.983957    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.087762 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.084309    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.188752 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.184682    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.307126 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.285039    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.417842 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.385509    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.427071 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.421661    2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 11 01:06:18.427071 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.421811    2555 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://a643fe31d63694f34a7d0c5f3ab74f9c-08d3862028dc4567.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events\": read tcp 10.0.139.236:51338->3.209.5.68:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-139-236.ec2.internal.18c116c86d969fda  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-236.ec2.internal,UID:ip-10-0-139-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-236.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-236.ec2.internal,},FirstTimestamp:2026-07-11 01:06:17.50328521 +0000 UTC m=+0.370253752,LastTimestamp:2026-07-11 01:06:17.50328521 +0000 UTC m=+0.370253752,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-236.ec2.internal,}"
Jul 11 01:06:18.526979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.480668    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 01:01:18 +0000 UTC" deadline="2028-01-08 21:08:51.517753617 +0000 UTC"
Jul 11 01:06:18.526979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.480690    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13124h2m33.037066137s"
Jul 11 01:06:18.526979 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.485757    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.526979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.490506    2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-236.ec2.internal" not found
Jul 11 01:06:18.526979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.506921    2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-236.ec2.internal" not found
Jul 11 01:06:18.562761 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.562737    2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-236.ec2.internal" not found
Jul 11 01:06:18.584045 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.583870    2555 manager.go:337] "Starting Device Plugin manager"
Jul 11 01:06:18.584175 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.584076    2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 11 01:06:18.584175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.584094    2555 server.go:87] "Starting device plugin registration server"
Jul 11 01:06:18.584465 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.584447    2555 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 11 01:06:18.584573 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.584466    2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 11 01:06:18.584573 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.584544    2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 11 01:06:18.584670 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.584627    2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 11 01:06:18.584670 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.584636    2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 11 01:06:18.585734 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.585701    2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 11 01:06:18.585867 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.585762    2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.685322 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.685274    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:18.686456 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.686388    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:18.686456 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.686421    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:18.686456 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.686433    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:18.686601 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.686465    2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.691336 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.691300    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 11 01:06:18.692562 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.692548    2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 11 01:06:18.692633 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.692590    2555 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 11 01:06:18.692633 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.692618    2555 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 11 01:06:18.692728 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.692657    2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 11 01:06:18.695352 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.695322    2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:18.695456 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.695353    2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.695456 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.695377    2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-236.ec2.internal\": node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.740798 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.740766    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.793844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.793743    2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"]
Jul 11 01:06:18.793844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.793849    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:18.795785 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.795770    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:18.795849 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.795800    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:18.795849 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.795810    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:18.797089 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797077    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:18.797260 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797245    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.797315 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797278    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:18.797899 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797880    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:18.797899 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797876    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:18.798045 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797929    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:18.798045 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797940    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:18.798045 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797908    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:18.798045 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.797992    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:18.799260 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.799245    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.799320 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.799271    2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 11 01:06:18.800132 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.800114    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 11 01:06:18.800242 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.800142    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 11 01:06:18.800242 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.800157    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeHasSufficientPID"
Jul 11 01:06:18.824940 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.824915    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-236.ec2.internal\" not found" node="ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.829666 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.829649    2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-236.ec2.internal\" not found" node="ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.840851 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.840830    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.848988 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.848967    2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:18.887191 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.887160    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/361a40d68276fef8638799dc16001981-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal\" (UID: \"361a40d68276fef8638799dc16001981\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.887334 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.887194    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/361a40d68276fef8638799dc16001981-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal\" (UID: \"361a40d68276fef8638799dc16001981\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.887334 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.887247    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c5c935c4e7d4f5442a1b6401a457b6f4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-236.ec2.internal\" (UID: \"c5c935c4e7d4f5442a1b6401a457b6f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.942249 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:18.942197    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:18.988177 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.988149    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/361a40d68276fef8638799dc16001981-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal\" (UID: \"361a40d68276fef8638799dc16001981\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.988261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.988181    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/361a40d68276fef8638799dc16001981-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal\" (UID: \"361a40d68276fef8638799dc16001981\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.988261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.988203    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c5c935c4e7d4f5442a1b6401a457b6f4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-236.ec2.internal\" (UID: \"c5c935c4e7d4f5442a1b6401a457b6f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.988334 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.988262    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c5c935c4e7d4f5442a1b6401a457b6f4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-236.ec2.internal\" (UID: \"c5c935c4e7d4f5442a1b6401a457b6f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.988334 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.988266    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/361a40d68276fef8638799dc16001981-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal\" (UID: \"361a40d68276fef8638799dc16001981\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:18.988334 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:18.988308    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/361a40d68276fef8638799dc16001981-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal\" (UID: \"361a40d68276fef8638799dc16001981\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:19.046096 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.046021    2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-236.ec2.internal\" not found"
Jul 11 01:06:19.071399 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.071376    2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:19.082824 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.082804    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:19.093758 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.093737    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 01:06:19.094512 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.094498    2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:19.103121 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.103106    2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 11 01:06:19.127774 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.127747    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:19.132404 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.132138    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal"
Jul 11 01:06:19.424847 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.424772    2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 11 01:06:19.457742 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.457717    2555 apiserver.go:52] "Watching apiserver"
Jul 11 01:06:19.467666 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.467646    2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 11 01:06:19.468848 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.468821    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vpd55","kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s58hn","openshift-dns/node-resolver-2zx5m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal","openshift-multus/multus-additional-cni-plugins-bbrn7","openshift-network-operator/iptables-alerter-lhsfm","openshift-ovn-kubernetes/ovnkube-node-9crv6","kube-system/global-pull-secret-syncer-2rhwb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl","openshift-image-registry/node-ca-8dffl","openshift-multus/multus-mxzsx","openshift-multus/network-metrics-daemon-5rltd","openshift-network-diagnostics/network-check-target-jmfgk"]
Jul 11 01:06:19.470292 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.470272    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.471602 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.471584    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.472733 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.472688    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.472953 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.472922    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6hl4q\""
Jul 11 01:06:19.473022 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.472974    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.473251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.473233    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.473351 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.473284    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 11 01:06:19.473896 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.473877    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.474279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.474258    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 11 01:06:19.474279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.474276    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.474446 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.474309    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.474446 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.474261    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wdfx6\""
Jul 11 01:06:19.475037 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.475021    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:19.475099 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.475080    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:19.475327 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.475312    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.475645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.475630    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7j592\""
Jul 11 01:06:19.476598 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.476379    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.476789 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.476770    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.477753 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.477730    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.478061 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.478040    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mqhg2\""
Jul 11 01:06:19.478142 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.478069    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.478373 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.478356    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.478495 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.478439    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:19.479645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.479626    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.479739 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.479617    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 11 01:06:19.479802 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.479775    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.479859 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.479805    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 11 01:06:19.480099 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.480077    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:19.480241 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.480133    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:19.480241 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.480174    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2zs79\""
Jul 11 01:06:19.480368 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.480300    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 11 01:06:19.481832 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.481816    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.483532 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.483512    2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 11 01:06:19.483633 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.483548    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.483974 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.483952    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 11 01:06:19.484128 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.484111    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 11 01:06:19.484253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.484238    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h7h8z\""
Jul 11 01:06:19.485758 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.485737    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.485758 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.485753    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 11 01:06:19.485940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.485782    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 11 01:06:19.485940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.485743    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.486096 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.486005    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.486204 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.486185    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 11 01:06:19.486204 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.486197    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9hbf\""
Jul 11 01:06:19.486495 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.486476    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 11 01:06:19.486590 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.486542    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 11 01:06:19.488328 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.488308    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 11 01:06:19.488471 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.488456    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4826t\""
Jul 11 01:06:19.488562 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.488518    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.488816 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.488803    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 11 01:06:19.490896 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.490878    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 11 01:06:19.491075 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.491063    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v7w8h\""
Jul 11 01:06:19.492292 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492273    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-run-netns\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.492338 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492313    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-lib-modules\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.492376 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492339    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqk8\" (UniqueName: \"kubernetes.io/projected/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-kube-api-access-7qqk8\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.492410 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-hosts-file\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.492410 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492403    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.492472 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492422    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvvk4\" (UniqueName: \"kubernetes.io/projected/e12b4b3b-324b-4e91-bf03-321700bce576-kube-api-access-xvvk4\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.492472 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-device-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.492537 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492472    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6w5t\" (UniqueName: \"kubernetes.io/projected/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-kube-api-access-j6w5t\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.492586 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492565    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:19.492621 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492606    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-sys\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.492654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492635    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-os-release\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.492704 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492664    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-socket-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.492704 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492692    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-cnibin\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.492804 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492730    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-kubelet\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.492857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492797    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.492857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492826    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-node-log\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.492857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q87hn\" (UniqueName: \"kubernetes.io/projected/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-kube-api-access-q87hn\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.493006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492876    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-host\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492901    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvfp\" (UniqueName: \"kubernetes.io/projected/f782678a-46cd-438f-8c5d-c6b9de5c2211-kube-api-access-7rvfp\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.493006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492924    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-serviceca\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.493006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492950    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-var-lib-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.492977    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-ovnkube-config\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493002    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-system-cni-dir\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493027    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493051    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-ovn\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493075    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493090    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68c7e928-54b0-4ddf-a551-7437bc054861-agent-certs\") pod \"konnectivity-agent-vpd55\" (UID: \"68c7e928-54b0-4ddf-a551-7437bc054861\") " pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493104    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-modprobe-d\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493132    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-systemd\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493160    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-var-lib-kubelet\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493185    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.493212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493205    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-registration-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493240    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-sys-fs\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493259    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-log-socket\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493317    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnjt\" (UniqueName: \"kubernetes.io/projected/7967365b-2032-4423-b322-77b5d99bddfb-kube-api-access-fmnjt\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493339    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-host-slash\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493355    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrnqn\" (UniqueName: \"kubernetes.io/projected/69707e06-c807-4a84-97ad-92925e8f1656-kube-api-access-nrnqn\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493388    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493404    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysctl-d\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493421    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493443    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a4945cf-0c27-46d5-bda4-074df6f855e0-kubelet-config\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493469    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-etc-selinux\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493484    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68c7e928-54b0-4ddf-a551-7437bc054861-konnectivity-ca\") pod \"konnectivity-agent-vpd55\" (UID: \"68c7e928-54b0-4ddf-a551-7437bc054861\") " pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.493507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493503    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-host\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493541    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-cni-netd\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493566    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysconfig\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493581    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysctl-conf\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493601    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-systemd-units\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493625    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7967365b-2032-4423-b322-77b5d99bddfb-ovn-node-metrics-cert\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493643    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-iptables-alerter-script\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493660    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-tuned\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493690    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493719    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-cni-bin\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493753    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-env-overrides\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493776    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-kubernetes\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493795    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzt78\" (UniqueName: \"kubernetes.io/projected/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-kube-api-access-tzt78\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493842    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a4945cf-0c27-46d5-bda4-074df6f855e0-dbus\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493861    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-slash\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.493881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493879    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-etc-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.494371 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493899    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-ovnkube-script-lib\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.494371 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493930    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-run\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.494371 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493948    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:19.494371 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493962    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-systemd\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.494371 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.493980    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-tmp\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.494371 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.494005    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-tmp-dir\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.494979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.494961    2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 11 01:06:19.515379 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.515358    2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cm6bl"
Jul 11 01:06:19.523149 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.523131    2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cm6bl"
Jul 11 01:06:19.583752 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.583733    2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 11 01:06:19.594192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594163    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.594309 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594208    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-registration-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.594309 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594242    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-sys-fs\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.594309 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594298    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-k8s-cni-cncf-io\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594335    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-log-socket\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594366    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-sys-fs\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594368    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.594405    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594439    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-log-socket\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594440    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnjt\" (UniqueName: \"kubernetes.io/projected/7967365b-2032-4423-b322-77b5d99bddfb-kube-api-access-fmnjt\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594473    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-host-slash\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594500    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-registration-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-cni-bin\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594542    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrnqn\" (UniqueName: \"kubernetes.io/projected/69707e06-c807-4a84-97ad-92925e8f1656-kube-api-access-nrnqn\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594549    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-host-slash\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.594582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594571    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.594592    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:20.094565966 +0000 UTC m=+2.961534523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594613    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-run-ovn-kubernetes\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594635    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysctl-d\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594667    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594693    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a4945cf-0c27-46d5-bda4-074df6f855e0-kubelet-config\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594717    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-etc-selinux\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594746    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68c7e928-54b0-4ddf-a551-7437bc054861-konnectivity-ca\") pod \"konnectivity-agent-vpd55\" (UID: \"68c7e928-54b0-4ddf-a551-7437bc054861\") " pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594771    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-host\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594794    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a4945cf-0c27-46d5-bda4-074df6f855e0-kubelet-config\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594819    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-host\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594876    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-etc-selinux\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594905    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-cni-netd\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594933    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-netns\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594943    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysctl-d\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594959    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysconfig\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.595175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594987    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysctl-conf\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.594995    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-cni-netd\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-socket-dir-parent\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595030    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysconfig\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595042    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-hostroot\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595083    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-multus-certs\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595108    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595119    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-sysctl-conf\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595121    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-systemd-units\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595151    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7967365b-2032-4423-b322-77b5d99bddfb-ovn-node-metrics-cert\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595179    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-iptables-alerter-script\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595179    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-systemd-units\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595206    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-tuned\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595239    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595266    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-cnibin\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595392    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-os-release\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595428    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-cni-bin\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.596323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595455    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-env-overrides\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595491    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-kubernetes\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595512    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-cni-bin\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzt78\" (UniqueName: \"kubernetes.io/projected/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-kube-api-access-tzt78\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595561    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a4945cf-0c27-46d5-bda4-074df6f855e0-dbus\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595541    2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595581    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68c7e928-54b0-4ddf-a551-7437bc054861-konnectivity-ca\") pod \"konnectivity-agent-vpd55\" (UID: \"68c7e928-54b0-4ddf-a551-7437bc054861\") " pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595588    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-system-cni-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595615    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9ea35b-70db-4270-bb64-edd93042f199-cni-binary-copy\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595681    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-kubernetes\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-slash\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595723    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-etc-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595731    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-slash\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595748    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-iptables-alerter-script\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595749    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-ovnkube-script-lib\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595790    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-etc-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595796    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-run\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595825    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:19.597224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595825    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a4945cf-0c27-46d5-bda4-074df6f855e0-dbus\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595876    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-run\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.595990    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-systemd\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596018    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-tmp\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596043    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-tmp-dir\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596067    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-run-netns\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596071    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-env-overrides\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596080    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-systemd\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596095    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-lib-modules\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596120    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqk8\" (UniqueName: \"kubernetes.io/projected/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-kube-api-access-7qqk8\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596127    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-run-netns\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596159    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-hosts-file\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596204    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596232    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvvk4\" (UniqueName: \"kubernetes.io/projected/e12b4b3b-324b-4e91-bf03-321700bce576-kube-api-access-xvvk4\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596289    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-device-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596316    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6w5t\" (UniqueName: \"kubernetes.io/projected/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-kube-api-access-j6w5t\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596343    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:19.598077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596380    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-cni-multus\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596403    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9ea35b-70db-4270-bb64-edd93042f199-multus-daemon-config\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596407    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-ovnkube-script-lib\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596417    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596434    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-sys\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596458    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-os-release\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596466    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-lib-modules\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596487    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-socket-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596491    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-device-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-sys\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596609    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-socket-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596682    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-os-release\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596730    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-hosts-file\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596770    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-tmp-dir\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.596800    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596824    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-cnibin\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.596848    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:20.096831174 +0000 UTC m=+2.963799709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:19.598606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596866    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-cnibin\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596896    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-etc-kubernetes\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596922    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jcxw\" (UniqueName: \"kubernetes.io/projected/bf9ea35b-70db-4270-bb64-edd93042f199-kube-api-access-8jcxw\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.596986    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-kubelet\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597014    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597041    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597061    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-node-log\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597094    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-host-kubelet\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597106    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597087    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q87hn\" (UniqueName: \"kubernetes.io/projected/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-kube-api-access-q87hn\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597143    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-host\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597159    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-node-log\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597172    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvfp\" (UniqueName: \"kubernetes.io/projected/f782678a-46cd-438f-8c5d-c6b9de5c2211-kube-api-access-7rvfp\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597202    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-cni-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597211    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-host\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597252    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-conf-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597333    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-serviceca\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.599133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597342    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e12b4b3b-324b-4e91-bf03-321700bce576-cni-binary-copy\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597367    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-var-lib-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-ovnkube-config\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597407    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-var-lib-openvswitch\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597425    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-system-cni-dir\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597453    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597480    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-ovn\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597522    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597535    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7967365b-2032-4423-b322-77b5d99bddfb-run-ovn\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68c7e928-54b0-4ddf-a551-7437bc054861-agent-certs\") pod \"konnectivity-agent-vpd55\" (UID: \"68c7e928-54b0-4ddf-a551-7437bc054861\") " pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597583    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-system-cni-dir\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597586    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-kubelet\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597618    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-modprobe-d\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597661    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-systemd\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597685    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-var-lib-kubelet\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597716    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e12b4b3b-324b-4e91-bf03-321700bce576-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597546    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f782678a-46cd-438f-8c5d-c6b9de5c2211-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.599770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597794    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-systemd\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597808    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-var-lib-kubelet\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597795    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-serviceca\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597886    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-modprobe-d\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.597898    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7967365b-2032-4423-b322-77b5d99bddfb-ovnkube-config\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.599402    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7967365b-2032-4423-b322-77b5d99bddfb-ovn-node-metrics-cert\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.599442    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-tmp\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.599445    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-etc-tuned\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.600295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.599766    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68c7e928-54b0-4ddf-a551-7437bc054861-agent-certs\") pod \"konnectivity-agent-vpd55\" (UID: \"68c7e928-54b0-4ddf-a551-7437bc054861\") " pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.603150 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.603123    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnjt\" (UniqueName: \"kubernetes.io/projected/7967365b-2032-4423-b322-77b5d99bddfb-kube-api-access-fmnjt\") pod \"ovnkube-node-9crv6\" (UID: \"7967365b-2032-4423-b322-77b5d99bddfb\") " pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.603456 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.603438    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrnqn\" (UniqueName: \"kubernetes.io/projected/69707e06-c807-4a84-97ad-92925e8f1656-kube-api-access-nrnqn\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:19.603618 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.603602    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzt78\" (UniqueName: \"kubernetes.io/projected/fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2-kube-api-access-tzt78\") pod \"node-resolver-2zx5m\" (UID: \"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2\") " pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.605195 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.605179    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:19.605258 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.605200    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:19.605258 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.605217    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:19.605361 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:19.605297    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:20.105263695 +0000 UTC m=+2.972232240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:19.607645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.607619    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6w5t\" (UniqueName: \"kubernetes.io/projected/a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d-kube-api-access-j6w5t\") pod \"node-ca-8dffl\" (UID: \"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d\") " pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.607847 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.607819    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqk8\" (UniqueName: \"kubernetes.io/projected/e520939d-ebfd-4edf-9a19-e1e5afa7ce65-kube-api-access-7qqk8\") pod \"tuned-s58hn\" (UID: \"e520939d-ebfd-4edf-9a19-e1e5afa7ce65\") " pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.609447 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.609425    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q87hn\" (UniqueName: \"kubernetes.io/projected/f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8-kube-api-access-q87hn\") pod \"iptables-alerter-lhsfm\" (UID: \"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8\") " pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.609532 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.609472    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvvk4\" (UniqueName: \"kubernetes.io/projected/e12b4b3b-324b-4e91-bf03-321700bce576-kube-api-access-xvvk4\") pod \"multus-additional-cni-plugins-bbrn7\" (UID: \"e12b4b3b-324b-4e91-bf03-321700bce576\") " pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.609778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.609758    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvfp\" (UniqueName: \"kubernetes.io/projected/f782678a-46cd-438f-8c5d-c6b9de5c2211-kube-api-access-7rvfp\") pod \"aws-ebs-csi-driver-node-bsthl\" (UID: \"f782678a-46cd-438f-8c5d-c6b9de5c2211\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.617759 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.617742    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl"
Jul 11 01:06:19.633947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.633928    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:19.698140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698052    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-cni-bin\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698098    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-netns\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698115    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-socket-dir-parent\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698167    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-cni-bin\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698182    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-socket-dir-parent\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698175    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-netns\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698200    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-hostroot\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698236    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-hostroot\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698264    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-multus-certs\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698316    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-cnibin\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698343    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-multus-certs\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-os-release\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698387    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-cnibin\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-system-cni-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698420    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9ea35b-70db-4270-bb64-edd93042f199-cni-binary-copy\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698433    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-os-release\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698501    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-cni-multus\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698508    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-system-cni-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698534    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9ea35b-70db-4270-bb64-edd93042f199-multus-daemon-config\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698568    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-etc-kubernetes\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698573    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-cni-multus\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698589    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jcxw\" (UniqueName: \"kubernetes.io/projected/bf9ea35b-70db-4270-bb64-edd93042f199-kube-api-access-8jcxw\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698643    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-etc-kubernetes\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698652    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-cni-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698688    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-conf-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698743    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-conf-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698754    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-multus-cni-dir\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698814    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-kubelet\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698873    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-k8s-cni-cncf-io\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.698929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698928    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-run-k8s-cni-cncf-io\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.699550 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.698967    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9ea35b-70db-4270-bb64-edd93042f199-host-var-lib-kubelet\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.699550 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.699026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf9ea35b-70db-4270-bb64-edd93042f199-cni-binary-copy\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.699550 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.699085    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bf9ea35b-70db-4270-bb64-edd93042f199-multus-daemon-config\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.707096 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.707074    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jcxw\" (UniqueName: \"kubernetes.io/projected/bf9ea35b-70db-4270-bb64-edd93042f199-kube-api-access-8jcxw\") pod \"multus-mxzsx\" (UID: \"bf9ea35b-70db-4270-bb64-edd93042f199\") " pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.793326 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.793293    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lhsfm"
Jul 11 01:06:19.808086 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.808064    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8dffl"
Jul 11 01:06:19.841280 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.841246    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s58hn"
Jul 11 01:06:19.853380 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.853352    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zx5m"
Jul 11 01:06:19.879474 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.879447    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bbrn7"
Jul 11 01:06:19.894629 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.894605    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:19.940662 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.940323    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mxzsx"
Jul 11 01:06:19.951808 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:19.951749    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c935c4e7d4f5442a1b6401a457b6f4.slice/crio-7c9d3174d3b4f923b20aacf0a4247abe3d457ef50e6e5e837aa01459620083c3 WatchSource:0}: Error finding container 7c9d3174d3b4f923b20aacf0a4247abe3d457ef50e6e5e837aa01459620083c3: Status 404 returned error can't find the container with id 7c9d3174d3b4f923b20aacf0a4247abe3d457ef50e6e5e837aa01459620083c3
Jul 11 01:06:19.952024 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:19.952002    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9ea35b_70db_4270_bb64_edd93042f199.slice/crio-efab9f4668dfd695902c112513a2f08f53c854b6c55dc3695010d972de5c31ac WatchSource:0}: Error finding container efab9f4668dfd695902c112513a2f08f53c854b6c55dc3695010d972de5c31ac: Status 404 returned error can't find the container with id efab9f4668dfd695902c112513a2f08f53c854b6c55dc3695010d972de5c31ac
Jul 11 01:06:19.960509 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:19.960492    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:06:19.969443 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:19.969416    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c7e928_54b0_4ddf_a551_7437bc054861.slice/crio-a1a2e828897cc609a05083cd23af0dccdc156a6c0899a25ff4fb1ccc0f86b04c WatchSource:0}: Error finding container a1a2e828897cc609a05083cd23af0dccdc156a6c0899a25ff4fb1ccc0f86b04c: Status 404 returned error can't find the container with id a1a2e828897cc609a05083cd23af0dccdc156a6c0899a25ff4fb1ccc0f86b04c
Jul 11 01:06:19.988669 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:19.988646    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361a40d68276fef8638799dc16001981.slice/crio-a1d0b450f021f171e6c629debd4f0d2423079cd7c45f7310a636272097b62a18 WatchSource:0}: Error finding container a1d0b450f021f171e6c629debd4f0d2423079cd7c45f7310a636272097b62a18: Status 404 returned error can't find the container with id a1d0b450f021f171e6c629debd4f0d2423079cd7c45f7310a636272097b62a18
Jul 11 01:06:20.047307 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:20.047281    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf782678a_46cd_438f_8c5d_c6b9de5c2211.slice/crio-2f5c55560be1b63ce18aacd239427ab884b133ed786f7b0c8a21d47cc80cccd7 WatchSource:0}: Error finding container 2f5c55560be1b63ce18aacd239427ab884b133ed786f7b0c8a21d47cc80cccd7: Status 404 returned error can't find the container with id 2f5c55560be1b63ce18aacd239427ab884b133ed786f7b0c8a21d47cc80cccd7
Jul 11 01:06:20.101485 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.101453    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:20.101619 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.101518    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:20.101619 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.101589    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:20.101619 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.101602    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:20.101727 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.101655    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:21.10163619 +0000 UTC m=+3.968604720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:20.101727 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.101675    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:21.101667654 +0000 UTC m=+3.968636183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:20.187888 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:20.187852    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c13304_5ac4_4cb1_8b9a_a2016d6ab0d8.slice/crio-bc16acc19007728c4f36d24ad5c37f0557cba26de9dffc13d4fd2fa86d332574 WatchSource:0}: Error finding container bc16acc19007728c4f36d24ad5c37f0557cba26de9dffc13d4fd2fa86d332574: Status 404 returned error can't find the container with id bc16acc19007728c4f36d24ad5c37f0557cba26de9dffc13d4fd2fa86d332574
Jul 11 01:06:20.202768 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.202701    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:20.202889 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.202871    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:20.202932 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.202893    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:20.202932 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.202903    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:20.203013 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.202959    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:21.202944416 +0000 UTC m=+4.069912946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:20.242555 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:20.242529    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode520939d_ebfd_4edf_9a19_e1e5afa7ce65.slice/crio-a2087048796e65be821fe422219c13dfaabd4501220af2fceeb99e7043add3cb WatchSource:0}: Error finding container a2087048796e65be821fe422219c13dfaabd4501220af2fceeb99e7043add3cb: Status 404 returned error can't find the container with id a2087048796e65be821fe422219c13dfaabd4501220af2fceeb99e7043add3cb
Jul 11 01:06:20.281341 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:20.281315    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbe7db2_a00e_4468_9a3b_51ec7a46ebe2.slice/crio-8d5fd3add0890762aa7807b6b0755482bb3a06c026a87d073630434a5ded87f8 WatchSource:0}: Error finding container 8d5fd3add0890762aa7807b6b0755482bb3a06c026a87d073630434a5ded87f8: Status 404 returned error can't find the container with id 8d5fd3add0890762aa7807b6b0755482bb3a06c026a87d073630434a5ded87f8
Jul 11 01:06:20.282629 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:20.282514    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d4c38a_21a1_4dc1_b8cb_c38e2c3ab64d.slice/crio-b390d603fc0e90a1ed52467bc1552529b20228b6ef609cea20c6eafd168c5ada WatchSource:0}: Error finding container b390d603fc0e90a1ed52467bc1552529b20228b6ef609cea20c6eafd168c5ada: Status 404 returned error can't find the container with id b390d603fc0e90a1ed52467bc1552529b20228b6ef609cea20c6eafd168c5ada
Jul 11 01:06:20.360589 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:20.360553    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12b4b3b_324b_4e91_bf03_321700bce576.slice/crio-8c41c9611ff93d9374f33f9e8f1e51e97a07058fd3189de7a2ead8608662a143 WatchSource:0}: Error finding container 8c41c9611ff93d9374f33f9e8f1e51e97a07058fd3189de7a2ead8608662a143: Status 404 returned error can't find the container with id 8c41c9611ff93d9374f33f9e8f1e51e97a07058fd3189de7a2ead8608662a143
Jul 11 01:06:20.527338 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.525859    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 01:01:20 +0000 UTC" deadline="2027-12-30 07:52:05.642576823 +0000 UTC"
Jul 11 01:06:20.527338 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.525925    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12894h45m45.11665678s"
Jul 11 01:06:20.694785 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.694754    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:20.695587 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:20.694891    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:20.709023 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.708959    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mxzsx" event={"ID":"bf9ea35b-70db-4270-bb64-edd93042f199","Type":"ContainerStarted","Data":"efab9f4668dfd695902c112513a2f08f53c854b6c55dc3695010d972de5c31ac"}
Jul 11 01:06:20.710947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.710915    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal" event={"ID":"c5c935c4e7d4f5442a1b6401a457b6f4","Type":"ContainerStarted","Data":"7c9d3174d3b4f923b20aacf0a4247abe3d457ef50e6e5e837aa01459620083c3"}
Jul 11 01:06:20.713874 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.713849    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerStarted","Data":"8c41c9611ff93d9374f33f9e8f1e51e97a07058fd3189de7a2ead8608662a143"}
Jul 11 01:06:20.717679 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.717654    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lhsfm" event={"ID":"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8","Type":"ContainerStarted","Data":"bc16acc19007728c4f36d24ad5c37f0557cba26de9dffc13d4fd2fa86d332574"}
Jul 11 01:06:20.725392 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.725346    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl" event={"ID":"f782678a-46cd-438f-8c5d-c6b9de5c2211","Type":"ContainerStarted","Data":"2f5c55560be1b63ce18aacd239427ab884b133ed786f7b0c8a21d47cc80cccd7"}
Jul 11 01:06:20.741043 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.741016    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vpd55" event={"ID":"68c7e928-54b0-4ddf-a551-7437bc054861","Type":"ContainerStarted","Data":"a1a2e828897cc609a05083cd23af0dccdc156a6c0899a25ff4fb1ccc0f86b04c"}
Jul 11 01:06:20.743876 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.743847    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8dffl" event={"ID":"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d","Type":"ContainerStarted","Data":"b390d603fc0e90a1ed52467bc1552529b20228b6ef609cea20c6eafd168c5ada"}
Jul 11 01:06:20.747834 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.747809    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zx5m" event={"ID":"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2","Type":"ContainerStarted","Data":"8d5fd3add0890762aa7807b6b0755482bb3a06c026a87d073630434a5ded87f8"}
Jul 11 01:06:20.754740 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.754315    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s58hn" event={"ID":"e520939d-ebfd-4edf-9a19-e1e5afa7ce65","Type":"ContainerStarted","Data":"a2087048796e65be821fe422219c13dfaabd4501220af2fceeb99e7043add3cb"}
Jul 11 01:06:20.763452 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:20.763423    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal" event={"ID":"361a40d68276fef8638799dc16001981","Type":"ContainerStarted","Data":"a1d0b450f021f171e6c629debd4f0d2423079cd7c45f7310a636272097b62a18"}
Jul 11 01:06:21.111907 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.111866    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:21.112107 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.111986    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:21.112182 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.112114    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:21.112243 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.112192    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:23.112168611 +0000 UTC m=+5.979137154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:21.112338 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.112283    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:21.112338 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.112324    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:23.112311709 +0000 UTC m=+5.979280255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:21.214727 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.214681    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:21.214922 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.214878    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:21.214922 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.214899    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:21.214922 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.214912    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:21.215090 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.214972    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:23.214953282 +0000 UTC m=+6.081921830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:21.318360 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:21.318161    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7967365b_2032_4423_b322_77b5d99bddfb.slice/crio-eec30d49df2d65e9497378aa049ce4dbdc7721a72d20e9806ebd7b352b2734d3 WatchSource:0}: Error finding container eec30d49df2d65e9497378aa049ce4dbdc7721a72d20e9806ebd7b352b2734d3: Status 404 returned error can't find the container with id eec30d49df2d65e9497378aa049ce4dbdc7721a72d20e9806ebd7b352b2734d3
Jul 11 01:06:21.526458 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.526368    2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 01:01:20 +0000 UTC" deadline="2028-04-04 18:29:41.271646598 +0000 UTC"
Jul 11 01:06:21.526458 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.526411    2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15209h23m19.745240299s"
Jul 11 01:06:21.693611 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.693568    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:21.693797 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.693749    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:21.693863 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.693839    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:21.693941 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:21.693921    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:21.791293 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:21.791181    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"eec30d49df2d65e9497378aa049ce4dbdc7721a72d20e9806ebd7b352b2734d3"}
Jul 11 01:06:22.693853 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:22.693813    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:22.694037 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:22.693947    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:23.133989 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:23.133885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:23.133989 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:23.133959    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:23.134686 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.134135    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:23.134686 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.134202    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:27.134183184 +0000 UTC m=+10.001151716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:23.134686 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.134634    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:23.134686 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.134687    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:27.134670467 +0000 UTC m=+10.001639001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:23.235925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:23.235190    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:23.235925 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.235438    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:23.235925 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.235462    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:23.235925 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.235485    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:23.235925 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.235554    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:27.23553365 +0000 UTC m=+10.102502198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:23.693600 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:23.693488    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:23.693600 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:23.693530    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:23.693819 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.693630    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:23.694150 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:23.694110    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:24.693555 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:24.693489    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:24.693936 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:24.693644    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:25.693572 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:25.693475    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:25.693572 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:25.693522    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:25.694114 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:25.693637    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:25.694114 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:25.693796    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:26.694069 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:26.694031    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:26.694608 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:26.694211    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:27.173345 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:27.172885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:27.173345 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:27.172956    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:27.173345 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.173071    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:27.173345 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.173139    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:35.173118886 +0000 UTC m=+18.040087419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:27.173718 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.173071    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:27.173718 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.173526    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:35.173507196 +0000 UTC m=+18.040475725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:27.274712 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:27.274005    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:27.274712 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.274195    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:27.274712 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.274214    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:27.274712 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.274227    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:27.274712 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.274308    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:35.274290033 +0000 UTC m=+18.141258586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:27.693179 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:27.693138    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:27.693388 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:27.693182    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:27.693388 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.693312    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:27.693579 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:27.693533    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:28.694511 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:28.694470    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:28.695011 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:28.694589    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:29.693443 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:29.693406    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:29.693660 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:29.693406    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:29.693660 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:29.693558    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:29.693783 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:29.693696    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:30.696786 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:30.696758    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:30.697295 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:30.696944    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:31.693421 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:31.693011    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:31.693421 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:31.693156    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:31.693421 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:31.693418    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:31.693707 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:31.693524    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:32.693799 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:32.693498    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:32.694174 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:32.693854    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:33.693765 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:33.693720    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:33.693936 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:33.693740    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:33.693936 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:33.693862    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:33.694319 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:33.693954    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:34.696444 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:34.696413    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:34.696851 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:34.696536    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:35.235509 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:35.235459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:35.235709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:35.235537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:35.235709 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.235626    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:35.235709 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.235696    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:51.235674555 +0000 UTC m=+34.102643088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:35.235709 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.235696    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:35.235942 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.235769    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:51.235746423 +0000 UTC m=+34.102714956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:35.336147 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:35.336110    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:35.336367 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.336344    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:35.336439 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.336378    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:35.336439 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.336392    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:35.336532 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.336461    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:51.336441713 +0000 UTC m=+34.203410258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:35.693178 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:35.693147    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:35.693374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:35.693153    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:35.693374 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.693296    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:35.693484 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:35.693450    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:36.693685 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:36.693613    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:36.694081 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:36.693741    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:37.693752 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:37.693718    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:37.694162 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:37.693843    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:37.694162 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:37.693880    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:37.694162 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:37.693937    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:38.696714 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:38.696682    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:38.697173 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:38.696802    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:39.692843 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:39.692805    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:39.693040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:39.692861    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:39.693040 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:39.692938    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:39.693145 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:39.693069    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:40.693269 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.693243    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:40.693663 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:40.693370    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:40.833441 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.833406    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s58hn" event={"ID":"e520939d-ebfd-4edf-9a19-e1e5afa7ce65","Type":"ContainerStarted","Data":"8b9755a84f36746b538779491fde9355b89c2c37af4b6bce9f7cebcb66314dd9"}
Jul 11 01:06:40.836643 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.836593    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mxzsx" event={"ID":"bf9ea35b-70db-4270-bb64-edd93042f199","Type":"ContainerStarted","Data":"10e640ec49beb4b195cefa565899761450657e7157a4da1007828abe0407923c"}
Jul 11 01:06:40.837956 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.837935    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal" event={"ID":"c5c935c4e7d4f5442a1b6401a457b6f4","Type":"ContainerStarted","Data":"776added68e9e0ebc212355e9c4aef433c3e9ac163f617923e7100069782d93b"}
Jul 11 01:06:40.849775 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.849732    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s58hn" podStartSLOduration=1.513660378 podStartE2EDuration="21.849717249s" totalImagesPullingTime="20.336056871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:40.849180843 +0000 UTC m=+23.716149393" watchObservedRunningTime="2026-07-11 01:06:40.849717249 +0000 UTC m=+23.716685798"
Jul 11 01:06:40.864470 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.864433    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mxzsx" podStartSLOduration=1.226444677 podStartE2EDuration="21.864420153s" totalImagesPullingTime="20.637975476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:40.864023732 +0000 UTC m=+23.730992284" watchObservedRunningTime="2026-07-11 01:06:40.864420153 +0000 UTC m=+23.731388702"
Jul 11 01:06:40.876493 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:40.876459    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-236.ec2.internal" podStartSLOduration=20.87644544 podStartE2EDuration="20.87644544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:40.876074457 +0000 UTC m=+23.743043007" watchObservedRunningTime="2026-07-11 01:06:40.87644544 +0000 UTC m=+23.743413989"
Jul 11 01:06:41.693869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.693601    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:41.694464 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.693660    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:41.694464 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:41.693959    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:41.694464 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:41.694022    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:41.841792 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.841762    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8dffl" event={"ID":"a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d","Type":"ContainerStarted","Data":"08d8265810f1bbd445eac1f3e73e393b61dd2e31275dc94ee2815b1c8e7d5b04"}
Jul 11 01:06:41.843139 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.843116    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zx5m" event={"ID":"fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2","Type":"ContainerStarted","Data":"a1ad2a361b15acb38ea4f4e610dc8495b2469b801589fc3148c75cc98ae01cc5"}
Jul 11 01:06:41.844432 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.844409    2555 generic.go:356] "Generic (PLEG): container finished" podID="361a40d68276fef8638799dc16001981" containerID="34e82ec95cbd4a0e45735e00eb09340d4f662a9b333505357508f8b15670212f" exitCode=0
Jul 11 01:06:41.844510 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.844474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal" event={"ID":"361a40d68276fef8638799dc16001981","Type":"ContainerDied","Data":"34e82ec95cbd4a0e45735e00eb09340d4f662a9b333505357508f8b15670212f"}
Jul 11 01:06:41.846717 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.846700    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:06:41.846990 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.846973    2555 generic.go:356] "Generic (PLEG): container finished" podID="7967365b-2032-4423-b322-77b5d99bddfb" containerID="005ddb9a28ee75c5d9bc223de857e4dded35c3a1a553e2bd2f14857a5df3fc75" exitCode=1
Jul 11 01:06:41.847037 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.847026    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"74dbb71b3c8c878372649f015f1881359efdc84a38d41739fd08b3a369addd57"}
Jul 11 01:06:41.847086 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.847078    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"a27e290bfa09ce9202d5bb2341f2d2035f217d05d90b0d959fe03947084fcab0"}
Jul 11 01:06:41.847143 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.847133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"8c6c51fc46582ccc454159f388de7505263ebdf149d5917b462b89b3f96043f7"}
Jul 11 01:06:41.847195 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.847166    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerDied","Data":"005ddb9a28ee75c5d9bc223de857e4dded35c3a1a553e2bd2f14857a5df3fc75"}
Jul 11 01:06:41.847262 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.847195    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"c79b39cd4b61e31bfc7cb611931f36eabbc50d4355deb958aad3306837a35cd2"}
Jul 11 01:06:41.848340 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.848321    2555 generic.go:356] "Generic (PLEG): container finished" podID="e12b4b3b-324b-4e91-bf03-321700bce576" containerID="d448c0a7002fa6c4937f4aa71f030066ef1eb6ff1e31c42dd3bcce8a5732aaef" exitCode=0
Jul 11 01:06:41.848427 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.848347    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerDied","Data":"d448c0a7002fa6c4937f4aa71f030066ef1eb6ff1e31c42dd3bcce8a5732aaef"}
Jul 11 01:06:41.849857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.849789    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl" event={"ID":"f782678a-46cd-438f-8c5d-c6b9de5c2211","Type":"ContainerStarted","Data":"bce1f4145544855a69d326769596a7da8c9c86d4f8fba2d26cd47789630d52f6"}
Jul 11 01:06:41.851163 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.851128    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vpd55" event={"ID":"68c7e928-54b0-4ddf-a551-7437bc054861","Type":"ContainerStarted","Data":"feffab6b1b04e415f4882d692575466bcdb24cf94f1775eb29bc24b02ec498e3"}
Jul 11 01:06:41.856324 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.856287    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8dffl" podStartSLOduration=2.5916807090000002 podStartE2EDuration="22.856274513s" totalImagesPullingTime="20.264593804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:41.855944769 +0000 UTC m=+24.722913321" watchObservedRunningTime="2026-07-11 01:06:41.856274513 +0000 UTC m=+24.723243063"
Jul 11 01:06:41.892437 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:41.892394    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vpd55" podStartSLOduration=2.495852617 podStartE2EDuration="22.8923796s" totalImagesPullingTime="20.396526983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:41.892347906 +0000 UTC m=+24.759316456" watchObservedRunningTime="2026-07-11 01:06:41.8923796 +0000 UTC m=+24.759348149"
Jul 11 01:06:42.208762 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.208673    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:42.209439 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.209419    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:42.224184 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.224140    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2zx5m" podStartSLOduration=3.134516261 podStartE2EDuration="23.224121907s" totalImagesPullingTime="20.089605646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:41.905822408 +0000 UTC m=+24.772790958" watchObservedRunningTime="2026-07-11 01:06:42.224121907 +0000 UTC m=+25.091090458"
Jul 11 01:06:42.693846 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.693817    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:42.694017 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:42.693950    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:42.856466 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.856442    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:06:42.856903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.856869    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"fda669cf748c4cf2d61cdc709423990d5ce814470d9072494b9feb78306ef1c9"}
Jul 11 01:06:42.858342 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.858312    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lhsfm" event={"ID":"f5c13304-5ac4-4cb1-8b9a-a2016d6ab0d8","Type":"ContainerStarted","Data":"e849e4e555ea9bc61f2ae88787442ffb38e77052c1985931efb9f71814a6fcbf"}
Jul 11 01:06:42.859170 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.859127    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:42.859631 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.859612    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vpd55"
Jul 11 01:06:42.887567 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.887523    2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 11 01:06:42.899660 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:42.899622    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lhsfm" podStartSLOduration=3.528168219 podStartE2EDuration="23.89960743s" totalImagesPullingTime="20.371439211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:42.89950877 +0000 UTC m=+25.766477321" watchObservedRunningTime="2026-07-11 01:06:42.89960743 +0000 UTC m=+25.766575991"
Jul 11 01:06:43.598754 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.598626    2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T01:06:42.887555637Z","UUID":"95d2139a-c0a3-4c68-a319-910ee9bcb7f7","Handler":null,"Name":"","Endpoint":""}
Jul 11 01:06:43.600430 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.600406    2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 11 01:06:43.600553 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.600452    2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 11 01:06:43.693932 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.693890    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:43.694114 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.693890    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:43.694114 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:43.694038    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:43.694114 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:43.694104    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:43.862662 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.862578    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal" event={"ID":"361a40d68276fef8638799dc16001981","Type":"ContainerStarted","Data":"56bb44cfea6da4ef3b7ee188c1258961f8abd881f0d3d519a13df912466ea4b2"}
Jul 11 01:06:43.864695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.864659    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl" event={"ID":"f782678a-46cd-438f-8c5d-c6b9de5c2211","Type":"ContainerStarted","Data":"048d9093021987cb81d375b631baaf253586fab8f85f7286a6f8b4f765ef3f10"}
Jul 11 01:06:43.876789 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:43.876752    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-236.ec2.internal" podStartSLOduration=23.876736296 podStartE2EDuration="23.876736296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:43.876647427 +0000 UTC m=+26.743615978" watchObservedRunningTime="2026-07-11 01:06:43.876736296 +0000 UTC m=+26.743704850"
Jul 11 01:06:44.698064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:44.698027    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:44.698415 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:44.698180    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:44.869645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:44.869598    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl" event={"ID":"f782678a-46cd-438f-8c5d-c6b9de5c2211","Type":"ContainerStarted","Data":"0d4e071559749b3a96439856cda0f0d2a946942a705ead90b9cabc3c8f59f95b"}
Jul 11 01:06:44.872911 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:44.872880    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:06:44.873345 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:44.873318    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"70d75beb344664d6131fc97d3eaff79c4d3b4a4ebf8f31b3de6f74e0e21b115c"}
Jul 11 01:06:44.888831 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:44.888792    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bsthl" podStartSLOduration=7.552948911 podStartE2EDuration="25.888778163s" totalImagesPullingTime="18.335829252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:44.888395937 +0000 UTC m=+27.755364488" watchObservedRunningTime="2026-07-11 01:06:44.888778163 +0000 UTC m=+27.755746769"
Jul 11 01:06:45.693971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:45.693732    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:45.694116 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:45.693733    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:45.694116 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:45.694040    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:45.694237 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:45.694140    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:46.695963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.695933    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:46.696535 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:46.696023    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:46.880625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.880453    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:06:46.880999 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.880968    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"ac6e1bbcf714bc8a3703bb0d988625d41b7480064c7338ddbc4bb55b377d1c70"}
Jul 11 01:06:46.881247 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.881227    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:46.881361 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.881296    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:46.881431 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.881412    2555 scope.go:117] "RemoveContainer" containerID="005ddb9a28ee75c5d9bc223de857e4dded35c3a1a553e2bd2f14857a5df3fc75"
Jul 11 01:06:46.882970 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.882945    2555 generic.go:356] "Generic (PLEG): container finished" podID="e12b4b3b-324b-4e91-bf03-321700bce576" containerID="0a302fc578abb59939087dcf9521a24b945517a8f6728d1a9d09922e5a17c374" exitCode=0
Jul 11 01:06:46.883056 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.882980    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerDied","Data":"0a302fc578abb59939087dcf9521a24b945517a8f6728d1a9d09922e5a17c374"}
Jul 11 01:06:46.898786 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:46.898765    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:47.692955 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.692921    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:47.692955 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.692942    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:47.693220 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:47.693060    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:47.693272 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:47.693197    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:47.888809 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.888786    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:06:47.889167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.889089    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" event={"ID":"7967365b-2032-4423-b322-77b5d99bddfb","Type":"ContainerStarted","Data":"5577ddd0733b606f1ca61d44f86ad9735ab380426fb4acb5321a8da8803c42b9"}
Jul 11 01:06:47.889440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.889411    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:47.903817 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.903792    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:06:47.914805 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:47.914764    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6" podStartSLOduration=9.035968572 podStartE2EDuration="28.914751417s" totalImagesPullingTime="19.878782845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:47.913219462 +0000 UTC m=+30.780188007" watchObservedRunningTime="2026-07-11 01:06:47.914751417 +0000 UTC m=+30.781719967"
Jul 11 01:06:48.288335 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.288310    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2rhwb"]
Jul 11 01:06:48.288545 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.288397    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:48.288545 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:48.288480    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:48.291119 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.291094    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jmfgk"]
Jul 11 01:06:48.291261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.291224    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:48.291337 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:48.291320    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:48.291692 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.291661    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rltd"]
Jul 11 01:06:48.291794 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.291738    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:48.291859 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:48.291811    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:48.893312 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.893275    2555 generic.go:356] "Generic (PLEG): container finished" podID="e12b4b3b-324b-4e91-bf03-321700bce576" containerID="184f99f94a24cccd4f309cda4faac316ad541d6b831fb380d985be1d7d4db8a9" exitCode=0
Jul 11 01:06:48.893772 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:48.893360    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerDied","Data":"184f99f94a24cccd4f309cda4faac316ad541d6b831fb380d985be1d7d4db8a9"}
Jul 11 01:06:49.693514 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:49.693477    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:49.693696 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:49.693488    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:49.693696 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:49.693620    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:49.693813 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:49.693690    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:50.697009 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:50.696981    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:50.697395 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:50.697084    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:50.900560 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:50.900528    2555 generic.go:356] "Generic (PLEG): container finished" podID="e12b4b3b-324b-4e91-bf03-321700bce576" containerID="b56fa657677b0b937280d196d7b67224e82c726c1ddea736cdab25ce45610d91" exitCode=0
Jul 11 01:06:50.900753 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:50.900600    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerDied","Data":"b56fa657677b0b937280d196d7b67224e82c726c1ddea736cdab25ce45610d91"}
Jul 11 01:06:51.263350 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:51.263121    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:51.263498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:51.263351    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:51.263498 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.263270    2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:51.263498 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.263436    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:51.263498 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.263451    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret podName:8a4945cf-0c27-46d5-bda4-074df6f855e0 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:23.263428457 +0000 UTC m=+66.130396992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret") pod "global-pull-secret-syncer-2rhwb" (UID: "8a4945cf-0c27-46d5-bda4-074df6f855e0") : object "kube-system"/"original-pull-secret" not registered
Jul 11 01:06:51.263498 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.263473    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:23.263461002 +0000 UTC m=+66.130429530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 11 01:06:51.364105 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:51.364073    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:51.364265 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.364236    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 11 01:06:51.364265 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.364254    2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 11 01:06:51.364265 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.364263    2555 projected.go:196] Error preparing data for projected volume kube-api-access-zjlnq for pod openshift-network-diagnostics/network-check-target-jmfgk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:51.364366 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.364315    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq podName:dd2d238f-a17b-4c34-b16d-60e38e5dd919 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:23.364298941 +0000 UTC m=+66.231267477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlnq" (UniqueName: "kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq") pod "network-check-target-jmfgk" (UID: "dd2d238f-a17b-4c34-b16d-60e38e5dd919") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 11 01:06:51.693744 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:51.693704    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:51.693904 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:51.693721    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:51.693952 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.693893    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:51.694047 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:51.694019    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:52.695631 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:52.695555    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:52.696052 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:52.695673    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:53.693220 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:53.693174    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:53.693389 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:53.693315    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:06:53.693389 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:53.693361    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:53.693540 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:53.693519    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jmfgk" podUID="dd2d238f-a17b-4c34-b16d-60e38e5dd919"
Jul 11 01:06:54.693363 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.693284    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:54.693805 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:54.693407    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2rhwb" podUID="8a4945cf-0c27-46d5-bda4-074df6f855e0"
Jul 11 01:06:54.888130 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.888102    2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-236.ec2.internal" event="NodeReady"
Jul 11 01:06:54.888318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.888257    2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 11 01:06:54.919042 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.919011    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f9575c8f4-v4x89"]
Jul 11 01:06:54.921215 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.921174    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:54.923659 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.923635    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 11 01:06:54.923782 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.923679    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fljvr\""
Jul 11 01:06:54.923782 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.923701    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 11 01:06:54.923992 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.923975    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 11 01:06:54.929146 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.929123    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 11 01:06:54.930092 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.929879    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rdxnw"]
Jul 11 01:06:54.931701 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.931679    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qn7nx"]
Jul 11 01:06:54.931801 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.931782    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:54.933755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.933670    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:54.934754 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.934354    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 11 01:06:54.936004 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.935247    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 11 01:06:54.936004 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.935508    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzrhh\""
Jul 11 01:06:54.936142 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.936009    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 11 01:06:54.937226 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.936675    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 11 01:06:54.937226 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.937119    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 11 01:06:54.937226 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.937153    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f9575c8f4-v4x89"]
Jul 11 01:06:54.937405 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.937282    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mzv2k\""
Jul 11 01:06:54.941187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.941165    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rdxnw"]
Jul 11 01:06:54.947118 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:54.947096    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qn7nx"]
Jul 11 01:06:55.092627 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092589    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp7lh\" (UniqueName: \"kubernetes.io/projected/0daca65b-a30d-4a91-a9e9-2afa12766d2e-kube-api-access-mp7lh\") pod \"ingress-canary-qn7nx\" (UID: \"0daca65b-a30d-4a91-a9e9-2afa12766d2e\") " pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.092783 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.092783 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092681    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59768a6f-9418-4613-8ca8-386fa451e526-ca-trust-extracted\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.092783 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092726    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b7g9\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-kube-api-access-2b7g9\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.092947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092797    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6fa1db6-107a-4ea2-93dc-11350c248b46-tmp-dir\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.092947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092833    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0daca65b-a30d-4a91-a9e9-2afa12766d2e-cert\") pod \"ingress-canary-qn7nx\" (UID: \"0daca65b-a30d-4a91-a9e9-2afa12766d2e\") " pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.092947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092894    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6fa1db6-107a-4ea2-93dc-11350c248b46-config-volume\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.092947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092932    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqtjb\" (UniqueName: \"kubernetes.io/projected/f6fa1db6-107a-4ea2-93dc-11350c248b46-kube-api-access-pqtjb\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.093132 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.092957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-image-registry-private-configuration\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.093132 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.093050    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-trusted-ca\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.093253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.093145    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.093253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.093182    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-registry-certificates\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.093253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.093223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-bound-sa-token\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.093373 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.093251    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-installation-pull-secrets\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194196 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194153    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp7lh\" (UniqueName: \"kubernetes.io/projected/0daca65b-a30d-4a91-a9e9-2afa12766d2e-kube-api-access-mp7lh\") pod \"ingress-canary-qn7nx\" (UID: \"0daca65b-a30d-4a91-a9e9-2afa12766d2e\") " pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.194382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194227    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59768a6f-9418-4613-8ca8-386fa451e526-ca-trust-extracted\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b7g9\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-kube-api-access-2b7g9\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194528 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.194451    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:55.194528 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.194469    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:06:55.194528 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194501    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6fa1db6-107a-4ea2-93dc-11350c248b46-tmp-dir\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.194528 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.194522    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:55.69450694 +0000 UTC m=+38.561475472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:06:55.194730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194553    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0daca65b-a30d-4a91-a9e9-2afa12766d2e-cert\") pod \"ingress-canary-qn7nx\" (UID: \"0daca65b-a30d-4a91-a9e9-2afa12766d2e\") " pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.194730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194580    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6fa1db6-107a-4ea2-93dc-11350c248b46-config-volume\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.194730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194603    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqtjb\" (UniqueName: \"kubernetes.io/projected/f6fa1db6-107a-4ea2-93dc-11350c248b46-kube-api-access-pqtjb\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.194730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194627    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-image-registry-private-configuration\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194681    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-trusted-ca\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194721    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194741    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59768a6f-9418-4613-8ca8-386fa451e526-ca-trust-extracted\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194754    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-registry-certificates\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194777    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-bound-sa-token\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194806    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-installation-pull-secrets\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.194825    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6fa1db6-107a-4ea2-93dc-11350c248b46-tmp-dir\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.194845    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:55.194979 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.194973    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:55.694951971 +0000 UTC m=+38.561920501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:55.195311 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.195197    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6fa1db6-107a-4ea2-93dc-11350c248b46-config-volume\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.195460 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.195436    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-registry-certificates\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.195725 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.195669    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-trusted-ca\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.199703 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.199661    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-image-registry-private-configuration\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.199703 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.199675    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-installation-pull-secrets\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.199703 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.199671    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0daca65b-a30d-4a91-a9e9-2afa12766d2e-cert\") pod \"ingress-canary-qn7nx\" (UID: \"0daca65b-a30d-4a91-a9e9-2afa12766d2e\") " pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.203268 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.203241    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqtjb\" (UniqueName: \"kubernetes.io/projected/f6fa1db6-107a-4ea2-93dc-11350c248b46-kube-api-access-pqtjb\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.203370 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.203344    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp7lh\" (UniqueName: \"kubernetes.io/projected/0daca65b-a30d-4a91-a9e9-2afa12766d2e-kube-api-access-mp7lh\") pod \"ingress-canary-qn7nx\" (UID: \"0daca65b-a30d-4a91-a9e9-2afa12766d2e\") " pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.204532 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.204474    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b7g9\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-kube-api-access-2b7g9\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.204740 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.204717    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-bound-sa-token\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.254996 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.254958    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qn7nx"
Jul 11 01:06:55.692820 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.692787    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:06:55.692995 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.692973    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:06:55.695843 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.695821    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ms55\""
Jul 11 01:06:55.696432 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.695953    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8v8tm\""
Jul 11 01:06:55.696432 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.695952    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 01:06:55.696432 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.696021    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 01:06:55.696432 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.696132    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 01:06:55.699419 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.699374    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:55.699603 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:55.699470    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:55.699603 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.699534    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:55.699603 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.699552    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:06:55.699603 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.699586    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:55.699838 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.699625    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:56.699605497 +0000 UTC m=+39.566574026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:06:55.699838 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:55.699643    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:56.699634305 +0000 UTC m=+39.566602833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:56.150901 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.150714    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qn7nx"]
Jul 11 01:06:56.153767 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:06:56.153742    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0daca65b_a30d_4a91_a9e9_2afa12766d2e.slice/crio-8cc1ff0dd66f6f8f57b95386efaded992505311ec4554c252a28049caae20b0e WatchSource:0}: Error finding container 8cc1ff0dd66f6f8f57b95386efaded992505311ec4554c252a28049caae20b0e: Status 404 returned error can't find the container with id 8cc1ff0dd66f6f8f57b95386efaded992505311ec4554c252a28049caae20b0e
Jul 11 01:06:56.695984 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.695957    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:06:56.698883 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.698868    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 01:06:56.706701 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.706677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:56.706806 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.706737    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:56.706867 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:56.706807    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:56.706867 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:56.706822    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:06:56.706867 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:56.706829    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:56.706867 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:56.706869    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:58.706854735 +0000 UTC m=+41.573823266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:06:56.707011 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:56.706881    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:06:58.706875665 +0000 UTC m=+41.573844192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:56.915844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.915811    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qn7nx" event={"ID":"0daca65b-a30d-4a91-a9e9-2afa12766d2e","Type":"ContainerStarted","Data":"8cc1ff0dd66f6f8f57b95386efaded992505311ec4554c252a28049caae20b0e"}
Jul 11 01:06:56.918517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.918491    2555 generic.go:356] "Generic (PLEG): container finished" podID="e12b4b3b-324b-4e91-bf03-321700bce576" containerID="7d7345d7604b79a920f41b2948b86932954de6874d393b13e1df6b44dd4089f4" exitCode=0
Jul 11 01:06:56.918660 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:56.918540    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerDied","Data":"7d7345d7604b79a920f41b2948b86932954de6874d393b13e1df6b44dd4089f4"}
Jul 11 01:06:57.924122 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:57.924089    2555 generic.go:356] "Generic (PLEG): container finished" podID="e12b4b3b-324b-4e91-bf03-321700bce576" containerID="4db69423016c42ed689cd048f37bc17b3a5599f533027b7453da5d639a6f1c8f" exitCode=0
Jul 11 01:06:57.924588 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:57.924156    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerDied","Data":"4db69423016c42ed689cd048f37bc17b3a5599f533027b7453da5d639a6f1c8f"}
Jul 11 01:06:58.719968 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:58.719931    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:06:58.720160 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:58.720027    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:06:58.720160 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:58.720103    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:06:58.720160 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:58.720126    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:06:58.720160 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:58.720131    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:06:58.720357 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:58.720192    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:02.720174402 +0000 UTC m=+45.587142934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:06:58.720357 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:06:58.720234    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:02.720221673 +0000 UTC m=+45.587190200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:06:58.932429 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:58.932384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" event={"ID":"e12b4b3b-324b-4e91-bf03-321700bce576","Type":"ContainerStarted","Data":"547078d321d814c7d7ed909caa3cd41e6633a7cc042060a6f0e07a3eaac27779"}
Jul 11 01:06:58.954311 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:58.954253    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bbrn7" podStartSLOduration=7.814807698 podStartE2EDuration="39.954233722s" totalImagesPullingTime="32.139426024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:58.952176946 +0000 UTC m=+41.819145496" watchObservedRunningTime="2026-07-11 01:06:58.954233722 +0000 UTC m=+41.821202272"
Jul 11 01:06:59.936270 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:59.936235    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qn7nx" event={"ID":"0daca65b-a30d-4a91-a9e9-2afa12766d2e","Type":"ContainerStarted","Data":"260f438d5719ec0273245952dfccf432fe7c669f6caea8f6a7f8ce62b44c0019"}
Jul 11 01:06:59.950941 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:06:59.950895    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qn7nx" podStartSLOduration=3.133613167 podStartE2EDuration="5.950878996s" totalImagesPullingTime="2.817265829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:06:59.950269959 +0000 UTC m=+42.817238510" watchObservedRunningTime="2026-07-11 01:06:59.950878996 +0000 UTC m=+42.817847547"
Jul 11 01:07:02.749481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:02.749445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:07:02.749827 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:02.749498    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:07:02.749827 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:02.749581    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:07:02.749827 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:02.749581    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:07:02.749827 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:02.749648    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:10.749630675 +0000 UTC m=+53.616599203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:07:02.749827 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:02.749592    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:07:02.749827 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:02.749719    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:10.749707675 +0000 UTC m=+53.616676202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:07:10.810625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:10.810584    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:07:10.811140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:10.810653    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:07:10.811140 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:10.810737    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:07:10.811140 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:10.810742    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:07:10.811140 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:10.810761    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:07:10.811140 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:10.810790    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:26.810776861 +0000 UTC m=+69.677745389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:07:10.811140 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:10.810808    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:26.810794459 +0000 UTC m=+69.677762987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:07:19.914804 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:19.914776    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9crv6"
Jul 11 01:07:23.303693 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.303651    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:07:23.304233 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.303706    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:07:23.306441 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.306418    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 11 01:07:23.306555 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.306482    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 11 01:07:23.314517 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:23.314499    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 01:07:23.314602 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:23.314575    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:08:27.314559082 +0000 UTC m=+130.181527613 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : secret "metrics-daemon-secret" not found
Jul 11 01:07:23.318048 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.318031    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a4945cf-0c27-46d5-bda4-074df6f855e0-original-pull-secret\") pod \"global-pull-secret-syncer-2rhwb\" (UID: \"8a4945cf-0c27-46d5-bda4-074df6f855e0\") " pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:07:23.404320 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.404292    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2rhwb"
Jul 11 01:07:23.404457 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.404437    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:07:23.407423 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.407408    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 11 01:07:23.418348 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.418327    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 11 01:07:23.428695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.428672    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjlnq\" (UniqueName: \"kubernetes.io/projected/dd2d238f-a17b-4c34-b16d-60e38e5dd919-kube-api-access-zjlnq\") pod \"network-check-target-jmfgk\" (UID: \"dd2d238f-a17b-4c34-b16d-60e38e5dd919\") " pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:07:23.520316 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.520287    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2rhwb"]
Jul 11 01:07:23.612429 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.612361    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8v8tm\""
Jul 11 01:07:23.620302 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.620285    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:07:23.745250 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.745196    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jmfgk"]
Jul 11 01:07:23.749090 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:07:23.749063    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2d238f_a17b_4c34_b16d_60e38e5dd919.slice/crio-4c0f45334fc1384144398e4547bcc2ac73a90659881d53e6fd98f99b628c505f WatchSource:0}: Error finding container 4c0f45334fc1384144398e4547bcc2ac73a90659881d53e6fd98f99b628c505f: Status 404 returned error can't find the container with id 4c0f45334fc1384144398e4547bcc2ac73a90659881d53e6fd98f99b628c505f
Jul 11 01:07:23.989830 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.989744    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jmfgk" event={"ID":"dd2d238f-a17b-4c34-b16d-60e38e5dd919","Type":"ContainerStarted","Data":"4c0f45334fc1384144398e4547bcc2ac73a90659881d53e6fd98f99b628c505f"}
Jul 11 01:07:23.990826 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:23.990807    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2rhwb" event={"ID":"8a4945cf-0c27-46d5-bda4-074df6f855e0","Type":"ContainerStarted","Data":"ee192fb51f74cc5c7ebd8db1abfcd4c48b1585c30e5964e6ddbd06bfe7ba5707"}
Jul 11 01:07:26.831915 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:26.831876    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:07:26.832354 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:26.831947    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:07:26.832354 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:26.832063    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:07:26.832354 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:26.832090    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:07:26.832354 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:26.832105    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:07:26.832354 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:26.832147    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:58.832126965 +0000 UTC m=+101.699095524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:07:26.832354 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:26.832170    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:07:58.832159089 +0000 UTC m=+101.699127618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:07:29.006589 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:29.006482    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jmfgk" event={"ID":"dd2d238f-a17b-4c34-b16d-60e38e5dd919","Type":"ContainerStarted","Data":"79afd98c0a59e008baff38d59b556802f7f1ccf57998edc11145599203865594"}
Jul 11 01:07:29.007052 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:29.006577    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:07:29.008226 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:29.008185    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2rhwb" event={"ID":"8a4945cf-0c27-46d5-bda4-074df6f855e0","Type":"ContainerStarted","Data":"b769e00f3c5baa1e2f53b90bfa668cb59b9f2e9aa8612378eef5ba5c7bb67c8e"}
Jul 11 01:07:29.020858 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:29.020815    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jmfgk" podStartSLOduration=65.028185847 podStartE2EDuration="1m10.020802971s" totalImagesPullingTime="4.992617124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:29.019548296 +0000 UTC m=+71.886516859" watchObservedRunningTime="2026-07-11 01:07:29.020802971 +0000 UTC m=+71.887771498"
Jul 11 01:07:35.761875 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.761815    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2rhwb" podStartSLOduration=71.533848287 podStartE2EDuration="1m16.761798234s" totalImagesPullingTime="5.227949947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:29.032641127 +0000 UTC m=+71.899609676" watchObservedRunningTime="2026-07-11 01:07:35.761798234 +0000 UTC m=+78.628766784"
Jul 11 01:07:35.762418 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.762402    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"]
Jul 11 01:07:35.764326 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.764310    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:35.766761 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.766738    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dgl2q\""
Jul 11 01:07:35.767951 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.767930    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 11 01:07:35.768054 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.767968    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 11 01:07:35.768054 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.767968    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 11 01:07:35.768218 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.767931    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 11 01:07:35.774397 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.774377    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"]
Jul 11 01:07:35.899162 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.899130    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqgf\" (UniqueName: \"kubernetes.io/projected/3a225db2-e37e-480d-9295-6d38ca9145c6-kube-api-access-7fqgf\") pod \"managed-serviceaccount-addon-agent-6b9c866c64-nvxzz\" (UID: \"3a225db2-e37e-480d-9295-6d38ca9145c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:35.899346 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.899184    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a225db2-e37e-480d-9295-6d38ca9145c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9c866c64-nvxzz\" (UID: \"3a225db2-e37e-480d-9295-6d38ca9145c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:35.999878 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.999846    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a225db2-e37e-480d-9295-6d38ca9145c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9c866c64-nvxzz\" (UID: \"3a225db2-e37e-480d-9295-6d38ca9145c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:36.000035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:35.999945    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqgf\" (UniqueName: \"kubernetes.io/projected/3a225db2-e37e-480d-9295-6d38ca9145c6-kube-api-access-7fqgf\") pod \"managed-serviceaccount-addon-agent-6b9c866c64-nvxzz\" (UID: \"3a225db2-e37e-480d-9295-6d38ca9145c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:36.002339 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:36.002309    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a225db2-e37e-480d-9295-6d38ca9145c6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6b9c866c64-nvxzz\" (UID: \"3a225db2-e37e-480d-9295-6d38ca9145c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:36.008375 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:36.008350    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqgf\" (UniqueName: \"kubernetes.io/projected/3a225db2-e37e-480d-9295-6d38ca9145c6-kube-api-access-7fqgf\") pod \"managed-serviceaccount-addon-agent-6b9c866c64-nvxzz\" (UID: \"3a225db2-e37e-480d-9295-6d38ca9145c6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:36.084627 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:36.084593    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"
Jul 11 01:07:36.198623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:36.198593    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz"]
Jul 11 01:07:36.202535 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:07:36.202504    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a225db2_e37e_480d_9295_6d38ca9145c6.slice/crio-6257b2779986a3a79bdb10ff29685e0971f10648407a973b01d44a3d1c290576 WatchSource:0}: Error finding container 6257b2779986a3a79bdb10ff29685e0971f10648407a973b01d44a3d1c290576: Status 404 returned error can't find the container with id 6257b2779986a3a79bdb10ff29685e0971f10648407a973b01d44a3d1c290576
Jul 11 01:07:37.030641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:37.030603    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz" event={"ID":"3a225db2-e37e-480d-9295-6d38ca9145c6","Type":"ContainerStarted","Data":"6257b2779986a3a79bdb10ff29685e0971f10648407a973b01d44a3d1c290576"}
Jul 11 01:07:39.037306 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:39.037271    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz" event={"ID":"3a225db2-e37e-480d-9295-6d38ca9145c6","Type":"ContainerStarted","Data":"7efe406f74375a5976667cba16974d9ac44539f28c91129309cb8f23e111efeb"}
Jul 11 01:07:39.051253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:39.051184    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz" podStartSLOduration=1.534976249 podStartE2EDuration="4.051171385s" totalImagesPullingTime="2.516195136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:07:39.051020598 +0000 UTC m=+81.917989151" watchObservedRunningTime="2026-07-11 01:07:39.051171385 +0000 UTC m=+81.918139934"
Jul 11 01:07:58.860437 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:58.860398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:07:58.860887 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:07:58.860457    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:07:58.860887 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:58.860546    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:07:58.860887 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:58.860586    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:07:58.860887 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:58.860600    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:07:58.860887 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:58.860620    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:09:02.860603359 +0000 UTC m=+165.727571887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:07:58.860887 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:07:58.860649    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:09:02.86063318 +0000 UTC m=+165.727601710 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:08:00.013558 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:08:00.013530    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jmfgk"
Jul 11 01:08:27.362051 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:08:27.362001    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:08:27.362476 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:08:27.362155    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 01:08:27.362476 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:08:27.362249    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:10:29.362231887 +0000 UTC m=+252.229200415 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : secret "metrics-daemon-secret" not found
Jul 11 01:08:57.932919 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:08:57.932876    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89" podUID="59768a6f-9418-4613-8ca8-386fa451e526"
Jul 11 01:08:57.949056 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:08:57.949022    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rdxnw" podUID="f6fa1db6-107a-4ea2-93dc-11350c248b46"
Jul 11 01:08:58.227904 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:08:58.227832    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:08:58.227904 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:08:58.227869    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:08:58.703949 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:08:58.703915    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:09:02.908366 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:02.908313    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") pod \"image-registry-7f9575c8f4-v4x89\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") " pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:09:02.908790 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:02.908398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:09:02.908790 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:09:02.908469    2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 11 01:09:02.908790 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:09:02.908481    2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 11 01:09:02.908790 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:09:02.908490    2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f9575c8f4-v4x89: secret "image-registry-tls" not found
Jul 11 01:09:02.908790 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:09:02.908539    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls podName:f6fa1db6-107a-4ea2-93dc-11350c248b46 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:04.908524052 +0000 UTC m=+287.775492580 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls") pod "dns-default-rdxnw" (UID: "f6fa1db6-107a-4ea2-93dc-11350c248b46") : secret "dns-default-metrics-tls" not found
Jul 11 01:09:02.908790 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:09:02.908552    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls podName:59768a6f-9418-4613-8ca8-386fa451e526 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:04.908546063 +0000 UTC m=+287.775514591 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls") pod "image-registry-7f9575c8f4-v4x89" (UID: "59768a6f-9418-4613-8ca8-386fa451e526") : secret "image-registry-tls" not found
Jul 11 01:09:12.693076 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:12.692979    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:09:39.327006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:39.326973    2555 generic.go:356] "Generic (PLEG): container finished" podID="3a225db2-e37e-480d-9295-6d38ca9145c6" containerID="7efe406f74375a5976667cba16974d9ac44539f28c91129309cb8f23e111efeb" exitCode=255
Jul 11 01:09:39.327439 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:39.327019    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz" event={"ID":"3a225db2-e37e-480d-9295-6d38ca9145c6","Type":"ContainerDied","Data":"7efe406f74375a5976667cba16974d9ac44539f28c91129309cb8f23e111efeb"}
Jul 11 01:09:39.332581 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:39.332559    2555 scope.go:117] "RemoveContainer" containerID="7efe406f74375a5976667cba16974d9ac44539f28c91129309cb8f23e111efeb"
Jul 11 01:09:40.331711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:09:40.331675    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6b9c866c64-nvxzz" event={"ID":"3a225db2-e37e-480d-9295-6d38ca9145c6","Type":"ContainerStarted","Data":"dc0413ef4fec843cffa5832d0eb4c0f00e09363fc8e8247fb2f469614eed0e84"}
Jul 11 01:10:29.400180 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:29.400128    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:10:29.400677 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:29.400288    2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 11 01:10:29.400677 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:29.400359    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs podName:69707e06-c807-4a84-97ad-92925e8f1656 nodeName:}" failed. No retries permitted until 2026-07-11 01:12:31.400343926 +0000 UTC m=+374.267312458 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs") pod "network-metrics-daemon-5rltd" (UID: "69707e06-c807-4a84-97ad-92925e8f1656") : secret "metrics-daemon-secret" not found
Jul 11 01:10:30.483811 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.483779    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b4b6c4b64-bdp2p"]
Jul 11 01:10:30.486709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.486693    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.488889 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.488869    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 11 01:10:30.489389 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.489362    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 11 01:10:30.489517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.489495    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.489517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.489506    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 11 01:10:30.489658 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.489578    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 11 01:10:30.489998 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.489975    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xrjdt\""
Jul 11 01:10:30.490087 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.490044    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.501987 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.501967    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b4b6c4b64-bdp2p"]
Jul 11 01:10:30.509075 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.509053    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-default-certificate\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.509161 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.509086    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.509161 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.509136    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-779d6\" (UniqueName: \"kubernetes.io/projected/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-kube-api-access-779d6\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.509260 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.509175    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.509260 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.509222    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-stats-auth\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.588573 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.588538    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"]
Jul 11 01:10:30.591374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.591351    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"
Jul 11 01:10:30.591553 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.591531    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"]
Jul 11 01:10:30.593617 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.593602    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-67f9s\""
Jul 11 01:10:30.594356 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.594335    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"
Jul 11 01:10:30.595176 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.595158    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ktqfz"]
Jul 11 01:10:30.596532 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.596513    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.596793 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.596774    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rrrtn\""
Jul 11 01:10:30.597100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.597084    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.597824 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.597808    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"]
Jul 11 01:10:30.597925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.597908    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.600216 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.600182    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.600550 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.600535    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 11 01:10:30.600686 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.600569    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.601121 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.601081    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b7cnb\""
Jul 11 01:10:30.601228 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.601185    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 11 01:10:30.601408 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.601382    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.602462 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.602442    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"]
Jul 11 01:10:30.603641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.603622    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 11 01:10:30.603755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.603685    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-97tn4\""
Jul 11 01:10:30.605228 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.605191    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 11 01:10:30.605457 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.605441    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 11 01:10:30.605727 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.605461    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 11 01:10:30.606637 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.606614    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"]
Jul 11 01:10:30.608097 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.608070    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 11 01:10:30.609833 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.609814    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ktqfz"]
Jul 11 01:10:30.610238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610215    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/11719803-2ed2-4d47-b2dd-acfdd82c7451-snapshots\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.610330 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610282    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-stats-auth\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.610330 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610315    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11719803-2ed2-4d47-b2dd-acfdd82c7451-tmp\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.610440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610337    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11719803-2ed2-4d47-b2dd-acfdd82c7451-serving-cert\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.610440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610360    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ct4\" (UniqueName: \"kubernetes.io/projected/2f2ee297-f8d7-478d-866e-bcaf75534040-kube-api-access-46ct4\") pod \"network-check-source-869dcfcdcd-g55bb\" (UID: \"2f2ee297-f8d7-478d-866e-bcaf75534040\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"
Jul 11 01:10:30.610440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.610440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610425    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-default-certificate\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.610641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610469    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-779d6\" (UniqueName: \"kubernetes.io/projected/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-kube-api-access-779d6\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.610641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610501    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd8nf\" (UniqueName: \"kubernetes.io/projected/11719803-2ed2-4d47-b2dd-acfdd82c7451-kube-api-access-vd8nf\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.610641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610536    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.610641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610593    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11719803-2ed2-4d47-b2dd-acfdd82c7451-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.610641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610626    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11719803-2ed2-4d47-b2dd-acfdd82c7451-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.610873 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610655    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drc8n\" (UniqueName: \"kubernetes.io/projected/2ec39d17-a3ab-4384-9b16-aff7902566bf-kube-api-access-drc8n\") pod \"volume-data-source-validator-78495597f6-x5wrb\" (UID: \"2ec39d17-a3ab-4384-9b16-aff7902566bf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"
Jul 11 01:10:30.610873 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:30.610835    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 01:10:30.610873 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.610871    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"]
Jul 11 01:10:30.611042 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:30.610894    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:31.110875419 +0000 UTC m=+253.977843946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : secret "router-metrics-certs-default" not found
Jul 11 01:10:30.611042 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:30.611033    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:31.111014172 +0000 UTC m=+253.977982701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : configmap references non-existent config key: service-ca.crt
Jul 11 01:10:30.613465 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.613429    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-default-certificate\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.613584 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.613434    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-stats-auth\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.620849 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.620828    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-779d6\" (UniqueName: \"kubernetes.io/projected/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-kube-api-access-779d6\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:30.711003 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.710971    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11719803-2ed2-4d47-b2dd-acfdd82c7451-serving-cert\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711003 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711006    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.711265 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711031    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ct4\" (UniqueName: \"kubernetes.io/projected/2f2ee297-f8d7-478d-866e-bcaf75534040-kube-api-access-46ct4\") pod \"network-check-source-869dcfcdcd-g55bb\" (UID: \"2f2ee297-f8d7-478d-866e-bcaf75534040\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"
Jul 11 01:10:30.711265 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.711265 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711115    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd8nf\" (UniqueName: \"kubernetes.io/projected/11719803-2ed2-4d47-b2dd-acfdd82c7451-kube-api-access-vd8nf\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711265 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711158    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtd99\" (UniqueName: \"kubernetes.io/projected/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-kube-api-access-xtd99\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.711265 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11719803-2ed2-4d47-b2dd-acfdd82c7451-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711523 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711274    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11719803-2ed2-4d47-b2dd-acfdd82c7451-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711523 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711329    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drc8n\" (UniqueName: \"kubernetes.io/projected/2ec39d17-a3ab-4384-9b16-aff7902566bf-kube-api-access-drc8n\") pod \"volume-data-source-validator-78495597f6-x5wrb\" (UID: \"2ec39d17-a3ab-4384-9b16-aff7902566bf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"
Jul 11 01:10:30.711523 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711415    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/11719803-2ed2-4d47-b2dd-acfdd82c7451-snapshots\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711652 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11719803-2ed2-4d47-b2dd-acfdd82c7451-tmp\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711847 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711814    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11719803-2ed2-4d47-b2dd-acfdd82c7451-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711952 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711916    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11719803-2ed2-4d47-b2dd-acfdd82c7451-tmp\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.711993 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.711962    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/11719803-2ed2-4d47-b2dd-acfdd82c7451-snapshots\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.712167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.712143    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11719803-2ed2-4d47-b2dd-acfdd82c7451-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.713421 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.713402    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11719803-2ed2-4d47-b2dd-acfdd82c7451-serving-cert\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.719015 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.718988    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drc8n\" (UniqueName: \"kubernetes.io/projected/2ec39d17-a3ab-4384-9b16-aff7902566bf-kube-api-access-drc8n\") pod \"volume-data-source-validator-78495597f6-x5wrb\" (UID: \"2ec39d17-a3ab-4384-9b16-aff7902566bf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"
Jul 11 01:10:30.719153 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.719133    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd8nf\" (UniqueName: \"kubernetes.io/projected/11719803-2ed2-4d47-b2dd-acfdd82c7451-kube-api-access-vd8nf\") pod \"insights-operator-68d9dd94cf-ktqfz\" (UID: \"11719803-2ed2-4d47-b2dd-acfdd82c7451\") " pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:30.719254 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.719237    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ct4\" (UniqueName: \"kubernetes.io/projected/2f2ee297-f8d7-478d-866e-bcaf75534040-kube-api-access-46ct4\") pod \"network-check-source-869dcfcdcd-g55bb\" (UID: \"2f2ee297-f8d7-478d-866e-bcaf75534040\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"
Jul 11 01:10:30.812724 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.812696    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.812867 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.812729    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.812867 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.812780    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtd99\" (UniqueName: \"kubernetes.io/projected/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-kube-api-access-xtd99\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.812942 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:30.812901    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:30.812983 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:30.812975    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls podName:8a3dc3a0-1b35-442e-bd5c-745ee4130cdd nodeName:}" failed. No retries permitted until 2026-07-11 01:10:31.312959301 +0000 UTC m=+254.179927843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-l5br6" (UID: "8a3dc3a0-1b35-442e-bd5c-745ee4130cdd") : secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:30.813449 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.813431    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.820921 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.820902    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtd99\" (UniqueName: \"kubernetes.io/projected/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-kube-api-access-xtd99\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:30.902810 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.902784    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"
Jul 11 01:10:30.911704 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.911678    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"
Jul 11 01:10:30.926927 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:30.926894    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz"
Jul 11 01:10:31.045147 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.045117    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb"]
Jul 11 01:10:31.049011 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:10:31.048979    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2ee297_f8d7_478d_866e_bcaf75534040.slice/crio-f773ea1563098171c4f2821f839b8e7f8b0f2d83ff22810babb2c38c16ab882a WatchSource:0}: Error finding container f773ea1563098171c4f2821f839b8e7f8b0f2d83ff22810babb2c38c16ab882a: Status 404 returned error can't find the container with id f773ea1563098171c4f2821f839b8e7f8b0f2d83ff22810babb2c38c16ab882a
Jul 11 01:10:31.062965 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.062911    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb"]
Jul 11 01:10:31.066028 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:10:31.066004    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec39d17_a3ab_4384_9b16_aff7902566bf.slice/crio-720c663a98e6cb52631fd43bbc39389759b5b5730868c4b7e9392fccee6f0242 WatchSource:0}: Error finding container 720c663a98e6cb52631fd43bbc39389759b5b5730868c4b7e9392fccee6f0242: Status 404 returned error can't find the container with id 720c663a98e6cb52631fd43bbc39389759b5b5730868c4b7e9392fccee6f0242
Jul 11 01:10:31.081561 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.081520    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ktqfz"]
Jul 11 01:10:31.084197 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:10:31.084174    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11719803_2ed2_4d47_b2dd_acfdd82c7451.slice/crio-8b2b0f79f86dbc99a11c144d1c8551923847cabead2473eaa15a584937b395b3 WatchSource:0}: Error finding container 8b2b0f79f86dbc99a11c144d1c8551923847cabead2473eaa15a584937b395b3: Status 404 returned error can't find the container with id 8b2b0f79f86dbc99a11c144d1c8551923847cabead2473eaa15a584937b395b3
Jul 11 01:10:31.115570 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.115543    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:31.115681 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.115587    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:31.115729 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:31.115709    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 01:10:31.115729 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:31.115714    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:32.115691854 +0000 UTC m=+254.982660390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : configmap references non-existent config key: service-ca.crt
Jul 11 01:10:31.115809 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:31.115748    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:32.11573646 +0000 UTC m=+254.982704988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : secret "router-metrics-certs-default" not found
Jul 11 01:10:31.317864 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.317774    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:31.318019 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:31.317896    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:31.318019 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:31.317978    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls podName:8a3dc3a0-1b35-442e-bd5c-745ee4130cdd nodeName:}" failed. No retries permitted until 2026-07-11 01:10:32.317953736 +0000 UTC m=+255.184922268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-l5br6" (UID: "8a3dc3a0-1b35-442e-bd5c-745ee4130cdd") : secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:31.472193 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.472158    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb" event={"ID":"2ec39d17-a3ab-4384-9b16-aff7902566bf","Type":"ContainerStarted","Data":"720c663a98e6cb52631fd43bbc39389759b5b5730868c4b7e9392fccee6f0242"}
Jul 11 01:10:31.473186 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.473162    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz" event={"ID":"11719803-2ed2-4d47-b2dd-acfdd82c7451","Type":"ContainerStarted","Data":"8b2b0f79f86dbc99a11c144d1c8551923847cabead2473eaa15a584937b395b3"}
Jul 11 01:10:31.474707 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.474683    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb" event={"ID":"2f2ee297-f8d7-478d-866e-bcaf75534040","Type":"ContainerStarted","Data":"e8eb564d1be593bcd2e72fa699c24d0ae93b08292f212b0bc37818e784add504"}
Jul 11 01:10:31.474806 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.474722    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb" event={"ID":"2f2ee297-f8d7-478d-866e-bcaf75534040","Type":"ContainerStarted","Data":"f773ea1563098171c4f2821f839b8e7f8b0f2d83ff22810babb2c38c16ab882a"}
Jul 11 01:10:31.490397 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:31.490350    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-g55bb" podStartSLOduration=1.4903338179999999 podStartE2EDuration="1.490333818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:31.489054174 +0000 UTC m=+254.356022727" watchObservedRunningTime="2026-07-11 01:10:31.490333818 +0000 UTC m=+254.357302368"
Jul 11 01:10:32.124427 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:32.124386    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:32.124619 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:32.124511    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:32.124619 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:32.124547    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 01:10:32.124619 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:32.124619    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:34.124600749 +0000 UTC m=+256.991569283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : secret "router-metrics-certs-default" not found
Jul 11 01:10:32.124781 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:32.124641    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:34.124630586 +0000 UTC m=+256.991599117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : configmap references non-existent config key: service-ca.crt
Jul 11 01:10:32.326467 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:32.326393    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:32.326639 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:32.326582    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:32.326751 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:32.326678    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls podName:8a3dc3a0-1b35-442e-bd5c-745ee4130cdd nodeName:}" failed. No retries permitted until 2026-07-11 01:10:34.326655399 +0000 UTC m=+257.193623931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-l5br6" (UID: "8a3dc3a0-1b35-442e-bd5c-745ee4130cdd") : secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:33.481661 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:33.481621    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb" event={"ID":"2ec39d17-a3ab-4384-9b16-aff7902566bf","Type":"ContainerStarted","Data":"beca93289fcd53ccf3f75d313ee59983161b36c15986d1e093441ea69c088862"}
Jul 11 01:10:33.496197 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:33.496157    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-x5wrb" podStartSLOduration=2.045200733 podStartE2EDuration="3.496140792s" totalImagesPullingTime="1.450940059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:33.495043698 +0000 UTC m=+256.362012247" watchObservedRunningTime="2026-07-11 01:10:33.496140792 +0000 UTC m=+256.363109341"
Jul 11 01:10:34.141287 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.141243    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:34.141467 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.141353    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:34.141467 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.141399    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 01:10:34.141467 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.141466    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.141451658 +0000 UTC m=+261.008420187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : secret "router-metrics-certs-default" not found
Jul 11 01:10:34.141653 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.141494    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.141482539 +0000 UTC m=+261.008451068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : configmap references non-existent config key: service-ca.crt
Jul 11 01:10:34.343378 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.343342    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:34.343570 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.343461    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:34.343570 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.343515    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls podName:8a3dc3a0-1b35-442e-bd5c-745ee4130cdd nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.343500562 +0000 UTC m=+261.210469090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-l5br6" (UID: "8a3dc3a0-1b35-442e-bd5c-745ee4130cdd") : secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:34.486241 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.486136    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz" event={"ID":"11719803-2ed2-4d47-b2dd-acfdd82c7451","Type":"ContainerStarted","Data":"e784f4e518c0d56198e603080e54737863cabe8cff687f8668f2c8fa0e6eef96"}
Jul 11 01:10:34.502063 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.502013    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz" podStartSLOduration=2.124334862 podStartE2EDuration="4.501997633s" totalImagesPullingTime="2.377662771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:34.501002138 +0000 UTC m=+257.367970688" watchObservedRunningTime="2026-07-11 01:10:34.501997633 +0000 UTC m=+257.368966183"
Jul 11 01:10:34.589056 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.589019    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8j5zc"]
Jul 11 01:10:34.592430 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.592406    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.594889 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.594868    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4nn2\""
Jul 11 01:10:34.595038 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.595020    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 11 01:10:34.595457 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.595443    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 11 01:10:34.603589 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.603569    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8j5zc"]
Jul 11 01:10:34.646489 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.646460    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.646623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.646501    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfq44\" (UniqueName: \"kubernetes.io/projected/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-api-access-sfq44\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.646623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.646547    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.646623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.646590    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e524e49-f563-4713-b940-8b0c7292cfaf-data-volume\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.646623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.646612    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e524e49-f563-4713-b940-8b0c7292cfaf-crio-socket\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748015 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.747936    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748015 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.747974    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfq44\" (UniqueName: \"kubernetes.io/projected/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-api-access-sfq44\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748015 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.748001    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748231 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.748081    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:34.748231 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.748097    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:34.748231 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.748132    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:35.248116939 +0000 UTC m=+258.115085469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:34.748231 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:34.748147    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:35.248141057 +0000 UTC m=+258.115109585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:34.748231 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.748165    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e524e49-f563-4713-b940-8b0c7292cfaf-data-volume\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748231 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.748189    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e524e49-f563-4713-b940-8b0c7292cfaf-crio-socket\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748428 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.748305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e524e49-f563-4713-b940-8b0c7292cfaf-crio-socket\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.748512 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.748483    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e524e49-f563-4713-b940-8b0c7292cfaf-data-volume\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:34.756520 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:34.756489    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfq44\" (UniqueName: \"kubernetes.io/projected/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-api-access-sfq44\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:35.251279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:35.251237    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:35.251424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:35.251298    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:35.251424 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:35.251408    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:35.251507 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:35.251423    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:35.251507 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:35.251476    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:36.251460114 +0000 UTC m=+259.118428642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:35.251507 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:35.251492    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:36.251485559 +0000 UTC m=+259.118454087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:36.258868 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:36.258831    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:36.259275 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:36.258890    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:36.259275 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:36.258994    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:36.259275 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:36.259030    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:36.259275 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:36.259053    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.259039566 +0000 UTC m=+261.126008095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:36.259275 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:36.259084    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:38.2590707 +0000 UTC m=+261.126039228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:36.360966 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:36.360937    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zx5m_fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2/dns-node-resolver/0.log"
Jul 11 01:10:37.651338 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.651299    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f8qd2"]
Jul 11 01:10:37.654418 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.654401    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.657137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.657112    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 11 01:10:37.657290 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.657184    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 11 01:10:37.657290 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.657254    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 11 01:10:37.658274 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.658256    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 11 01:10:37.658524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.658512    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hfdjz\""
Jul 11 01:10:37.663796 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.663775    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f8qd2"]
Jul 11 01:10:37.760649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.760624    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8dffl_a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d/node-ca/0.log"
Jul 11 01:10:37.771574 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.771547    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2zct\" (UniqueName: \"kubernetes.io/projected/97f9de94-e853-4024-b38b-1bd4ea1aebf7-kube-api-access-j2zct\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.771711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.771596    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97f9de94-e853-4024-b38b-1bd4ea1aebf7-signing-key\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.771760 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.771708    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97f9de94-e853-4024-b38b-1bd4ea1aebf7-signing-cabundle\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.872061 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.872032    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2zct\" (UniqueName: \"kubernetes.io/projected/97f9de94-e853-4024-b38b-1bd4ea1aebf7-kube-api-access-j2zct\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.872194 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.872084    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97f9de94-e853-4024-b38b-1bd4ea1aebf7-signing-key\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.872194 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.872164    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97f9de94-e853-4024-b38b-1bd4ea1aebf7-signing-cabundle\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.872818 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.872787    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97f9de94-e853-4024-b38b-1bd4ea1aebf7-signing-cabundle\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.874487 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.874467    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97f9de94-e853-4024-b38b-1bd4ea1aebf7-signing-key\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.879911 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.879892    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2zct\" (UniqueName: \"kubernetes.io/projected/97f9de94-e853-4024-b38b-1bd4ea1aebf7-kube-api-access-j2zct\") pod \"service-ca-79f68b9f4f-f8qd2\" (UID: \"97f9de94-e853-4024-b38b-1bd4ea1aebf7\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:37.963517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:37.963443    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2"
Jul 11 01:10:38.082060 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.082032    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f8qd2"]
Jul 11 01:10:38.085063 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:10:38.085036    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f9de94_e853_4024_b38b_1bd4ea1aebf7.slice/crio-a6d6e8db3d442993cf2150073e2065d99e32028aa77e1843c08f36416f09eaff WatchSource:0}: Error finding container a6d6e8db3d442993cf2150073e2065d99e32028aa77e1843c08f36416f09eaff: Status 404 returned error can't find the container with id a6d6e8db3d442993cf2150073e2065d99e32028aa77e1843c08f36416f09eaff
Jul 11 01:10:38.175287 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.175255    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:38.175479 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.175396    2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 11 01:10:38.175479 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.175395    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:38.175479 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.175457    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.175441503 +0000 UTC m=+269.042410031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : secret "router-metrics-certs-default" not found
Jul 11 01:10:38.175613 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.175494    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.175474864 +0000 UTC m=+269.042443396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : configmap references non-existent config key: service-ca.crt
Jul 11 01:10:38.276520 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.276445    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:38.276520 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.276496    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:38.276713 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.276557    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:38.276713 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.276614    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:38.276713 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.276671    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:42.276651184 +0000 UTC m=+265.143619715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:38.276713 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.276694    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:42.276688257 +0000 UTC m=+265.143656786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:38.377452 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.377418    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:38.377593 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.377560    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:38.377634 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:38.377617    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls podName:8a3dc3a0-1b35-442e-bd5c-745ee4130cdd nodeName:}" failed. No retries permitted until 2026-07-11 01:10:46.377603968 +0000 UTC m=+269.244572499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-l5br6" (UID: "8a3dc3a0-1b35-442e-bd5c-745ee4130cdd") : secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:38.498285 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.498250    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2" event={"ID":"97f9de94-e853-4024-b38b-1bd4ea1aebf7","Type":"ContainerStarted","Data":"a6d6e8db3d442993cf2150073e2065d99e32028aa77e1843c08f36416f09eaff"}
Jul 11 01:10:38.561222 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:38.561176    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qn7nx_0daca65b-a30d-4a91-a9e9-2afa12766d2e/serve-healthcheck-canary/0.log"
Jul 11 01:10:40.511531 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:40.511448    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2" event={"ID":"97f9de94-e853-4024-b38b-1bd4ea1aebf7","Type":"ContainerStarted","Data":"32ac2d1924a077cf38ea46a454fceca2f2a2d921a4bb3e149550ba07db740100"}
Jul 11 01:10:40.526608 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:40.526560    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-f8qd2" podStartSLOduration=1.451118592 podStartE2EDuration="3.526537141s" totalImagesPullingTime="2.075418549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:10:40.526109838 +0000 UTC m=+263.393078399" watchObservedRunningTime="2026-07-11 01:10:40.526537141 +0000 UTC m=+263.393505690"
Jul 11 01:10:42.310768 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:42.310720    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:42.311264 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:42.310805    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:42.311264 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:42.310894    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:42.311264 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:42.310921    2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 11 01:10:42.311264 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:42.310977    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:50.310961649 +0000 UTC m=+273.177930177 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : configmap "kube-rbac-proxy" not found
Jul 11 01:10:42.311264 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:42.310991    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:10:50.310984584 +0000 UTC m=+273.177953112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:46.247215 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:46.247165    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:46.247587 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:46.247245    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:46.247587 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:46.247324    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle podName:c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb nodeName:}" failed. No retries permitted until 2026-07-11 01:11:02.247305014 +0000 UTC m=+285.114273542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle") pod "router-default-5b4b6c4b64-bdp2p" (UID: "c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb") : configmap references non-existent config key: service-ca.crt
Jul 11 01:10:46.249570 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:46.249550    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-metrics-certs\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:10:46.449017 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:46.448972    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:10:46.449185 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:46.449105    2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:46.449248 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:46.449185    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls podName:8a3dc3a0-1b35-442e-bd5c-745ee4130cdd nodeName:}" failed. No retries permitted until 2026-07-11 01:11:02.449164868 +0000 UTC m=+285.316133409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-l5br6" (UID: "8a3dc3a0-1b35-442e-bd5c-745ee4130cdd") : secret "cluster-monitoring-operator-tls" not found
Jul 11 01:10:50.382519 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:50.382474    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:50.382955 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:50.382540    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:50.382955 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:50.382701    2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:50.382955 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:50.382785    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls podName:6e524e49-f563-4713-b940-8b0c7292cfaf nodeName:}" failed. No retries permitted until 2026-07-11 01:11:06.382767599 +0000 UTC m=+289.249736126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8j5zc" (UID: "6e524e49-f563-4713-b940-8b0c7292cfaf") : secret "insights-runtime-extractor-tls" not found
Jul 11 01:10:50.383237 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:50.383187    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e524e49-f563-4713-b940-8b0c7292cfaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:10:58.953890 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:58.953852    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f9575c8f4-v4x89"]
Jul 11 01:10:58.954289 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:10:58.954074    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89" podUID="59768a6f-9418-4613-8ca8-386fa451e526"
Jul 11 01:10:59.571416 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.571384    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:10:59.579039 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.579008    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:10:59.661012 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.660970    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-image-registry-private-configuration\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661012 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661011    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-installation-pull-secrets\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661054    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-registry-certificates\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661104    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b7g9\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-kube-api-access-2b7g9\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661147    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-bound-sa-token\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661179    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59768a6f-9418-4613-8ca8-386fa451e526-ca-trust-extracted\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661433 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661239    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-trusted-ca\") pod \"59768a6f-9418-4613-8ca8-386fa451e526\" (UID: \"59768a6f-9418-4613-8ca8-386fa451e526\") "
Jul 11 01:10:59.661535 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661501    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:10:59.661665 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661632    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59768a6f-9418-4613-8ca8-386fa451e526-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:10:59.661793 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.661769    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:10:59.663444 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.663410    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:10:59.663537 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.663477    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:10:59.663764 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.663729    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:10:59.663846 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.663824    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-kube-api-access-2b7g9" (OuterVolumeSpecName: "kube-api-access-2b7g9") pod "59768a6f-9418-4613-8ca8-386fa451e526" (UID: "59768a6f-9418-4613-8ca8-386fa451e526"). InnerVolumeSpecName "kube-api-access-2b7g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:10:59.761963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.761927    2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-registry-certificates\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:10:59.761963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.761957    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b7g9\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-kube-api-access-2b7g9\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:10:59.761963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.761967    2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-bound-sa-token\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:10:59.762181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.761975    2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/59768a6f-9418-4613-8ca8-386fa451e526-ca-trust-extracted\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:10:59.762181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.761985    2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/59768a6f-9418-4613-8ca8-386fa451e526-trusted-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:10:59.762181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.761995    2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-image-registry-private-configuration\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:10:59.762181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:10:59.762003    2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/59768a6f-9418-4613-8ca8-386fa451e526-installation-pull-secrets\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:11:00.573991 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:00.573961    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f9575c8f4-v4x89"
Jul 11 01:11:00.604589 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:00.604559    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f9575c8f4-v4x89"]
Jul 11 01:11:00.607890 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:00.607865    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f9575c8f4-v4x89"]
Jul 11 01:11:00.696779 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:00.696746    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59768a6f-9418-4613-8ca8-386fa451e526" path="/var/lib/kubelet/pods/59768a6f-9418-4613-8ca8-386fa451e526/volumes"
Jul 11 01:11:00.771860 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:00.771830    2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/59768a6f-9418-4613-8ca8-386fa451e526-registry-tls\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:11:01.228895 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:01.228843    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rdxnw" podUID="f6fa1db6-107a-4ea2-93dc-11350c248b46"
Jul 11 01:11:01.576748 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:01.576720    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:11:02.285144 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.285105    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:02.285777 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.285756    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb-service-ca-bundle\") pod \"router-default-5b4b6c4b64-bdp2p\" (UID: \"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb\") " pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:02.295123 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.295095    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:02.430979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.430944    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b4b6c4b64-bdp2p"]
Jul 11 01:11:02.433877 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:02.433849    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6975d9f_2bf4_46b8_8e1c_c3a4406d0cdb.slice/crio-4fd31c878843de7ae1d8f873a9fb92ec5ea7cb4bf22a9544a234980412ae9594 WatchSource:0}: Error finding container 4fd31c878843de7ae1d8f873a9fb92ec5ea7cb4bf22a9544a234980412ae9594: Status 404 returned error can't find the container with id 4fd31c878843de7ae1d8f873a9fb92ec5ea7cb4bf22a9544a234980412ae9594
Jul 11 01:11:02.486908 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.486883    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:11:02.489004 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.488976    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8a3dc3a0-1b35-442e-bd5c-745ee4130cdd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-l5br6\" (UID: \"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:11:02.581468 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.581376    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p" event={"ID":"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb","Type":"ContainerStarted","Data":"6dac4fa46ad4cbfcfb8a1413fd2704b73a4fc86f23cf6bfba0cd35f16d39ff8e"}
Jul 11 01:11:02.581468 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.581435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p" event={"ID":"c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb","Type":"ContainerStarted","Data":"4fd31c878843de7ae1d8f873a9fb92ec5ea7cb4bf22a9544a234980412ae9594"}
Jul 11 01:11:02.600172 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.600124    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p" podStartSLOduration=32.600109236 podStartE2EDuration="32.600109236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:02.599568841 +0000 UTC m=+285.466537392" watchObservedRunningTime="2026-07-11 01:11:02.600109236 +0000 UTC m=+285.467077786"
Jul 11 01:11:02.731485 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.731452    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"
Jul 11 01:11:02.852534 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:02.852507    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6"]
Jul 11 01:11:02.854726 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:02.854703    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3dc3a0_1b35_442e_bd5c_745ee4130cdd.slice/crio-6556bb7c9af1d301dc5ed98ee34437c624197a801144725c364c8fad03187841 WatchSource:0}: Error finding container 6556bb7c9af1d301dc5ed98ee34437c624197a801144725c364c8fad03187841: Status 404 returned error can't find the container with id 6556bb7c9af1d301dc5ed98ee34437c624197a801144725c364c8fad03187841
Jul 11 01:11:03.295283 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:03.295244    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:03.297684 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:03.297661    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:03.586320 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:03.586237    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6" event={"ID":"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd","Type":"ContainerStarted","Data":"6556bb7c9af1d301dc5ed98ee34437c624197a801144725c364c8fad03187841"}
Jul 11 01:11:03.586767 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:03.586462    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:03.587802 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:03.587780    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b4b6c4b64-bdp2p"
Jul 11 01:11:05.008314 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.008278    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:11:05.011088 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.011022    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6fa1db6-107a-4ea2-93dc-11350c248b46-metrics-tls\") pod \"dns-default-rdxnw\" (UID: \"f6fa1db6-107a-4ea2-93dc-11350c248b46\") " pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:11:05.179780 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.179696    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzrhh\""
Jul 11 01:11:05.187605 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.187583    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:11:05.250702 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.250638    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"]
Jul 11 01:11:05.254134 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.254109    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:05.256517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.256494    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 11 01:11:05.256623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.256526    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6fkjg\""
Jul 11 01:11:05.262404 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.262338    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"]
Jul 11 01:11:05.326226 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.326180    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rdxnw"]
Jul 11 01:11:05.329276 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:05.329236    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fa1db6_107a_4ea2_93dc_11350c248b46.slice/crio-069152c51f218d0a6d18d8c469915b681118168705c08e2980d9f8948264a41a WatchSource:0}: Error finding container 069152c51f218d0a6d18d8c469915b681118168705c08e2980d9f8948264a41a: Status 404 returned error can't find the container with id 069152c51f218d0a6d18d8c469915b681118168705c08e2980d9f8948264a41a
Jul 11 01:11:05.411609 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.411573    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d3c1f703-a51e-47ef-a974-1723ce374d70-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kgl8x\" (UID: \"d3c1f703-a51e-47ef-a974-1723ce374d70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:05.512537 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.512435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d3c1f703-a51e-47ef-a974-1723ce374d70-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kgl8x\" (UID: \"d3c1f703-a51e-47ef-a974-1723ce374d70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:05.512686 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:05.512581    2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 11 01:11:05.512686 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:05.512667    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c1f703-a51e-47ef-a974-1723ce374d70-tls-certificates podName:d3c1f703-a51e-47ef-a974-1723ce374d70 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:06.012630167 +0000 UTC m=+288.879598694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d3c1f703-a51e-47ef-a974-1723ce374d70-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-kgl8x" (UID: "d3c1f703-a51e-47ef-a974-1723ce374d70") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 11 01:11:05.594212 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.594169    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6" event={"ID":"8a3dc3a0-1b35-442e-bd5c-745ee4130cdd","Type":"ContainerStarted","Data":"84b942aaf608559f99396bf9013df741cbb06ec27f45ba982e7c3971321014d6"}
Jul 11 01:11:05.595464 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.595435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rdxnw" event={"ID":"f6fa1db6-107a-4ea2-93dc-11350c248b46","Type":"ContainerStarted","Data":"069152c51f218d0a6d18d8c469915b681118168705c08e2980d9f8948264a41a"}
Jul 11 01:11:05.609565 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:05.609519    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-l5br6" podStartSLOduration=33.684801878 podStartE2EDuration="35.609504519s" totalImagesPullingTime="1.924702641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:05.608232607 +0000 UTC m=+288.475201158" watchObservedRunningTime="2026-07-11 01:11:05.609504519 +0000 UTC m=+288.476473069"
Jul 11 01:11:06.017730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.017692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d3c1f703-a51e-47ef-a974-1723ce374d70-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kgl8x\" (UID: \"d3c1f703-a51e-47ef-a974-1723ce374d70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:06.020524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.020495    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d3c1f703-a51e-47ef-a974-1723ce374d70-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kgl8x\" (UID: \"d3c1f703-a51e-47ef-a974-1723ce374d70\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:06.166943 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.166906    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:06.290796 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.290765    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"]
Jul 11 01:11:06.293931 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:06.293897    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c1f703_a51e_47ef_a974_1723ce374d70.slice/crio-efac396a613f5ecac3e7f402122bb104ac075585d6ac8d7d5090f78e5850d242 WatchSource:0}: Error finding container efac396a613f5ecac3e7f402122bb104ac075585d6ac8d7d5090f78e5850d242: Status 404 returned error can't find the container with id efac396a613f5ecac3e7f402122bb104ac075585d6ac8d7d5090f78e5850d242
Jul 11 01:11:06.422993 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.422935    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:11:06.425358 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.425333    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e524e49-f563-4713-b940-8b0c7292cfaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8j5zc\" (UID: \"6e524e49-f563-4713-b940-8b0c7292cfaf\") " pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:11:06.600442 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.600358    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x" event={"ID":"d3c1f703-a51e-47ef-a974-1723ce374d70","Type":"ContainerStarted","Data":"efac396a613f5ecac3e7f402122bb104ac075585d6ac8d7d5090f78e5850d242"}
Jul 11 01:11:06.701724 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:06.701699    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8j5zc"
Jul 11 01:11:07.278109 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:07.278078    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8j5zc"]
Jul 11 01:11:07.281558 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:07.281536    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e524e49_f563_4713_b940_8b0c7292cfaf.slice/crio-d3a869b5f8fa6f2ec0c77177459ea0dd3883f202d1bd7ad688e0dbf14d79e9a6 WatchSource:0}: Error finding container d3a869b5f8fa6f2ec0c77177459ea0dd3883f202d1bd7ad688e0dbf14d79e9a6: Status 404 returned error can't find the container with id d3a869b5f8fa6f2ec0c77177459ea0dd3883f202d1bd7ad688e0dbf14d79e9a6
Jul 11 01:11:07.605267 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:07.605230    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8j5zc" event={"ID":"6e524e49-f563-4713-b940-8b0c7292cfaf","Type":"ContainerStarted","Data":"d3a869b5f8fa6f2ec0c77177459ea0dd3883f202d1bd7ad688e0dbf14d79e9a6"}
Jul 11 01:11:07.606901 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:07.606861    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rdxnw" event={"ID":"f6fa1db6-107a-4ea2-93dc-11350c248b46","Type":"ContainerStarted","Data":"ee5c5f67a088505f6a6ab35def18cd5d1093cd25107925a243f7a35c5544bd48"}
Jul 11 01:11:07.607043 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:07.606914    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rdxnw" event={"ID":"f6fa1db6-107a-4ea2-93dc-11350c248b46","Type":"ContainerStarted","Data":"3da4015245422599ac7b873da1607f410615b69dffc36e4d52983693eaf9641d"}
Jul 11 01:11:07.607043 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:07.607023    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:11:07.624172 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:07.624129    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rdxnw" podStartSLOduration=251.747353312 podStartE2EDuration="4m13.624114168s" totalImagesPullingTime="1.876760856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:07.622794164 +0000 UTC m=+290.489762713" watchObservedRunningTime="2026-07-11 01:11:07.624114168 +0000 UTC m=+290.491082717"
Jul 11 01:11:08.612902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:08.612854    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x" event={"ID":"d3c1f703-a51e-47ef-a974-1723ce374d70","Type":"ContainerStarted","Data":"400a409a4961f4a0651df31c15f82b348c7a72e09d8e6a166b92b0a9c23ede76"}
Jul 11 01:11:08.613379 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:08.613354    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:08.618360 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:08.618337    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x"
Jul 11 01:11:08.627132 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:08.627077    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kgl8x" podStartSLOduration=1.9780652239999998 podStartE2EDuration="3.627059231s" totalImagesPullingTime="1.648994007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:08.626549573 +0000 UTC m=+291.493518124" watchObservedRunningTime="2026-07-11 01:11:08.627059231 +0000 UTC m=+291.494027784"
Jul 11 01:11:09.307010 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.306973    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ggnhm"]
Jul 11 01:11:09.310136 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.310104    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.314012 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.313966    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 11 01:11:09.314012 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.313981    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 11 01:11:09.314012 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.313987    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 11 01:11:09.314275 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.313966    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-29tv5\""
Jul 11 01:11:09.318309 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.318250    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ggnhm"]
Jul 11 01:11:09.344802 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.344769    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.344976 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.344834    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.344976 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.344957    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmpkf\" (UniqueName: \"kubernetes.io/projected/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-kube-api-access-bmpkf\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.345099 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.344992    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.446428 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.446392    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmpkf\" (UniqueName: \"kubernetes.io/projected/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-kube-api-access-bmpkf\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.446940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.446885    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.447076 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.446986    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.447076 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.447062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.447338 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:09.447309    2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 11 01:11:09.448269 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:09.448247    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-tls podName:2e1a77b7-7cac-44cf-8243-2ac540ff8bc1 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:09.948219519 +0000 UTC m=+292.815188068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-tls") pod "prometheus-operator-64785b6675-ggnhm" (UID: "2e1a77b7-7cac-44cf-8243-2ac540ff8bc1") : secret "prometheus-operator-tls" not found
Jul 11 01:11:09.448269 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.448262    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.454307 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.454252    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.455434 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.455382    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmpkf\" (UniqueName: \"kubernetes.io/projected/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-kube-api-access-bmpkf\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.951699 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.951649    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:09.954323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:09.954298    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e1a77b7-7cac-44cf-8243-2ac540ff8bc1-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ggnhm\" (UID: \"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:10.222548 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:10.222215    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm"
Jul 11 01:11:11.243011 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:11.242985    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ggnhm"]
Jul 11 01:11:11.245598 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:11.245557    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1a77b7_7cac_44cf_8243_2ac540ff8bc1.slice/crio-0df21fd28c8b947e8bb5398743f299bcc415368a16af643186275c2494794db7 WatchSource:0}: Error finding container 0df21fd28c8b947e8bb5398743f299bcc415368a16af643186275c2494794db7: Status 404 returned error can't find the container with id 0df21fd28c8b947e8bb5398743f299bcc415368a16af643186275c2494794db7
Jul 11 01:11:11.625049 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:11.625014    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8j5zc" event={"ID":"6e524e49-f563-4713-b940-8b0c7292cfaf","Type":"ContainerStarted","Data":"280a5e85fc23bdaed7f8a95479f215daa72463f3c46c44b8f1f8f09765f86f51"}
Jul 11 01:11:11.626280 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:11.626248    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm" event={"ID":"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1","Type":"ContainerStarted","Data":"0df21fd28c8b947e8bb5398743f299bcc415368a16af643186275c2494794db7"}
Jul 11 01:11:12.632389 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:12.632350    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8j5zc" event={"ID":"6e524e49-f563-4713-b940-8b0c7292cfaf","Type":"ContainerStarted","Data":"2aa069cb09b88aba7621bc6f059352ec9791b7acb7ef899569563d996754cbb6"}
Jul 11 01:11:13.638584 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:13.638542    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm" event={"ID":"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1","Type":"ContainerStarted","Data":"fdfda587aa51745d083bbb909d7146ebc96b748497dc706319217cb1858a1e9d"}
Jul 11 01:11:13.639001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:13.638614    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm" event={"ID":"2e1a77b7-7cac-44cf-8243-2ac540ff8bc1","Type":"ContainerStarted","Data":"dcc5bf46ab49388fa1cf74c94f8887ed0ee1788a0f51a24eb9d8e019d6896045"}
Jul 11 01:11:13.655756 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:13.655706    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-ggnhm" podStartSLOduration=3.096161277 podStartE2EDuration="4.655691264s" totalImagesPullingTime="1.559529987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:13.654704384 +0000 UTC m=+296.521672934" watchObservedRunningTime="2026-07-11 01:11:13.655691264 +0000 UTC m=+296.522659813"
Jul 11 01:11:14.643298 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:14.643261    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8j5zc" event={"ID":"6e524e49-f563-4713-b940-8b0c7292cfaf","Type":"ContainerStarted","Data":"f4c76a46a62a4376e2727c6b86cd198acedebeb48ba87ca77efe6d3620a4f2fd"}
Jul 11 01:11:14.660248 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:14.660178    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8j5zc" podStartSLOduration=33.805720997 podStartE2EDuration="40.660161622s" totalImagesPullingTime="6.854440625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:10:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:14.658702011 +0000 UTC m=+297.525670561" watchObservedRunningTime="2026-07-11 01:11:14.660161622 +0000 UTC m=+297.527130172"
Jul 11 01:11:15.682324 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.682291    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wm5bw"]
Jul 11 01:11:15.685685 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.685664    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.688141 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.687881    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-spdn4\""
Jul 11 01:11:15.688141 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.687933    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 11 01:11:15.688141 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.688000    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 11 01:11:15.688359 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.688244    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 11 01:11:15.693479 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:15.693451    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5rltd" podUID="69707e06-c807-4a84-97ad-92925e8f1656"
Jul 11 01:11:15.703472 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.703447    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-accelerators-collector-config\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.703626 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.703605    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-wtmp\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.703803 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.703785    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-tls\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.703994 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.703978    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxfvq\" (UniqueName: \"kubernetes.io/projected/3b6fbc2f-6e7d-447e-a117-2437a8787a37-kube-api-access-lxfvq\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.704255 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.704232    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-textfile\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.704384 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.704368    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b6fbc2f-6e7d-447e-a117-2437a8787a37-metrics-client-ca\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.704497 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.704482    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.704599 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.704586    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-sys\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.704715 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.704703    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-root\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805376 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805339    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxfvq\" (UniqueName: \"kubernetes.io/projected/3b6fbc2f-6e7d-447e-a117-2437a8787a37-kube-api-access-lxfvq\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805588 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805414    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-textfile\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805588 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805441    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b6fbc2f-6e7d-447e-a117-2437a8787a37-metrics-client-ca\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805758    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805793    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-textfile\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805808    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-sys\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805852    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-sys\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805862    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-root\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805896    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-root\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.805925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805912    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-accelerators-collector-config\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.806343 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-wtmp\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.806343 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.805971    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-tls\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.806343 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.806054    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b6fbc2f-6e7d-447e-a117-2437a8787a37-metrics-client-ca\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.806343 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:15.806085    2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 11 01:11:15.806343 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:11:15.806142    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-tls podName:3b6fbc2f-6e7d-447e-a117-2437a8787a37 nodeName:}" failed. No retries permitted until 2026-07-11 01:11:16.306124028 +0000 UTC m=+299.173092571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-tls") pod "node-exporter-wm5bw" (UID: "3b6fbc2f-6e7d-447e-a117-2437a8787a37") : secret "node-exporter-tls" not found
Jul 11 01:11:15.806546 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.806344    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-wtmp\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.806546 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.806479    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-accelerators-collector-config\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.808823 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.808768    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:15.813589 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:15.813559    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxfvq\" (UniqueName: \"kubernetes.io/projected/3b6fbc2f-6e7d-447e-a117-2437a8787a37-kube-api-access-lxfvq\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:16.310056 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:16.310019    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-tls\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:16.312392 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:16.312369    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b6fbc2f-6e7d-447e-a117-2437a8787a37-node-exporter-tls\") pod \"node-exporter-wm5bw\" (UID: \"3b6fbc2f-6e7d-447e-a117-2437a8787a37\") " pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:16.597238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:16.597098    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wm5bw"
Jul 11 01:11:16.653067 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:16.653029    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wm5bw" event={"ID":"3b6fbc2f-6e7d-447e-a117-2437a8787a37","Type":"ContainerStarted","Data":"7dd024ec1c139212e0cfefa137c47d511b6acddd1802cee8ee51ded31d1b8e8b"}
Jul 11 01:11:17.615221 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.615177    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rdxnw"
Jul 11 01:11:17.639275 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.639240    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"]
Jul 11 01:11:17.642995 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.642972    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.643865 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.643840    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:11:17.644342 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.644324    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:11:17.645606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.645545    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 11 01:11:17.645857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.645739    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f3a2u1c25v71j\""
Jul 11 01:11:17.645857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.645762    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bjxpm\""
Jul 11 01:11:17.645857 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.645778    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 11 01:11:17.646034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.645944    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 11 01:11:17.646034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.646001    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 11 01:11:17.646251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.646234    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 11 01:11:17.660823 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.660800    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"]
Jul 11 01:11:17.662709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.662661    2555 kubelet.go:1648] "Image garbage collection succeeded"
Jul 11 01:11:17.724137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.723894    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.723932    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5648ec6-a20a-4bb5-8686-dcd8e323812b-metrics-client-ca\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.723971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.724018    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.724060    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-tls\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724417 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.724136    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbrzf\" (UniqueName: \"kubernetes.io/projected/d5648ec6-a20a-4bb5-8686-dcd8e323812b-kube-api-access-dbrzf\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724417 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.724246    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.724417 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.724290    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-grpc-tls\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825486 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825455    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825604 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825494    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5648ec6-a20a-4bb5-8686-dcd8e323812b-metrics-client-ca\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825604 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825604 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825556    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825604 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825582    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-tls\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825793 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825636    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbrzf\" (UniqueName: \"kubernetes.io/projected/d5648ec6-a20a-4bb5-8686-dcd8e323812b-kube-api-access-dbrzf\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825793 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825669    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.825793 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.825699    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-grpc-tls\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.826289 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.826260    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5648ec6-a20a-4bb5-8686-dcd8e323812b-metrics-client-ca\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.828066 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.828035    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.828177 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.828157    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.828501 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.828476    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.828576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.828510    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-tls\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.828576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.828532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-grpc-tls\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.828576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.828550    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5648ec6-a20a-4bb5-8686-dcd8e323812b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.833276 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.833261    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbrzf\" (UniqueName: \"kubernetes.io/projected/d5648ec6-a20a-4bb5-8686-dcd8e323812b-kube-api-access-dbrzf\") pod \"thanos-querier-7cf5f7967f-4smsz\" (UID: \"d5648ec6-a20a-4bb5-8686-dcd8e323812b\") " pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:17.955595 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:17.955520    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:18.088032 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:18.088002    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"]
Jul 11 01:11:18.091421 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:18.091395    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5648ec6_a20a_4bb5_8686_dcd8e323812b.slice/crio-1f02ab7af58c619a07dc8780391c3b124006ccf129f3389b859d065aa7fb283f WatchSource:0}: Error finding container 1f02ab7af58c619a07dc8780391c3b124006ccf129f3389b859d065aa7fb283f: Status 404 returned error can't find the container with id 1f02ab7af58c619a07dc8780391c3b124006ccf129f3389b859d065aa7fb283f
Jul 11 01:11:18.667817 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:18.667773    2555 generic.go:356] "Generic (PLEG): container finished" podID="3b6fbc2f-6e7d-447e-a117-2437a8787a37" containerID="75575e01430470ac4ece49e01d01f0da60eedec438d5411d0f62d55c9472e046" exitCode=0
Jul 11 01:11:18.668226 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:18.667912    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wm5bw" event={"ID":"3b6fbc2f-6e7d-447e-a117-2437a8787a37","Type":"ContainerDied","Data":"75575e01430470ac4ece49e01d01f0da60eedec438d5411d0f62d55c9472e046"}
Jul 11 01:11:18.669666 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:18.669630    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"1f02ab7af58c619a07dc8780391c3b124006ccf129f3389b859d065aa7fb283f"}
Jul 11 01:11:19.676028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:19.675986    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wm5bw" event={"ID":"3b6fbc2f-6e7d-447e-a117-2437a8787a37","Type":"ContainerStarted","Data":"7dbbfe033ade0ebbd5e3304809e4427445242d6f5f9c56816df2c8edc7d7d66a"}
Jul 11 01:11:19.676531 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:19.676049    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wm5bw" event={"ID":"3b6fbc2f-6e7d-447e-a117-2437a8787a37","Type":"ContainerStarted","Data":"10090c54fd486281876d5ab58d242ec0a2c21afd6f374fde09ba9130c4d623c2"}
Jul 11 01:11:19.694768 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:19.694706    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wm5bw" podStartSLOduration=3.5736405959999997 podStartE2EDuration="4.694686889s" totalImagesPullingTime="1.058301466s" totalInitContainerRuntime="62.744827ms" isStatefulPod=true podCreationTimestamp="2026-07-11 01:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:19.694106753 +0000 UTC m=+302.561075302" watchObservedRunningTime="2026-07-11 01:11:19.694686889 +0000 UTC m=+302.561655451"
Jul 11 01:11:20.326665 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.326639    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:11:20.447929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.447851    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"]
Jul 11 01:11:20.450991 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.450972    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.453416 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.453390    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 11 01:11:20.453533 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.453417    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2cl6d\""
Jul 11 01:11:20.459671 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.459638    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"]
Jul 11 01:11:20.552459 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.552419    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fd5a735-30ca-4217-911c-b0d0265fa8ad-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-j5vjn\" (UID: \"6fd5a735-30ca-4217-911c-b0d0265fa8ad\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.552597 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.552487    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbnp\" (UniqueName: \"kubernetes.io/projected/6fd5a735-30ca-4217-911c-b0d0265fa8ad-kube-api-access-plbnp\") pod \"monitoring-plugin-5f68df7f58-j5vjn\" (UID: \"6fd5a735-30ca-4217-911c-b0d0265fa8ad\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.653485 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.653435    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plbnp\" (UniqueName: \"kubernetes.io/projected/6fd5a735-30ca-4217-911c-b0d0265fa8ad-kube-api-access-plbnp\") pod \"monitoring-plugin-5f68df7f58-j5vjn\" (UID: \"6fd5a735-30ca-4217-911c-b0d0265fa8ad\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.653643 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.653549    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fd5a735-30ca-4217-911c-b0d0265fa8ad-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-j5vjn\" (UID: \"6fd5a735-30ca-4217-911c-b0d0265fa8ad\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.656180 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.656146    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6fd5a735-30ca-4217-911c-b0d0265fa8ad-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-j5vjn\" (UID: \"6fd5a735-30ca-4217-911c-b0d0265fa8ad\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.661167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.661144    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbnp\" (UniqueName: \"kubernetes.io/projected/6fd5a735-30ca-4217-911c-b0d0265fa8ad-kube-api-access-plbnp\") pod \"monitoring-plugin-5f68df7f58-j5vjn\" (UID: \"6fd5a735-30ca-4217-911c-b0d0265fa8ad\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.681981 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.681952    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"58ab224d0d9f8ff8fffd1af0b1fc83fd52ed15c5aa6d9f411bf51ca524cdf561"}
Jul 11 01:11:20.682285 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.682015    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"9f938c669b590e6447748e2ee7df46c657aa81e471b6a28d790409d0a4048147"}
Jul 11 01:11:20.682285 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.682042    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"59ccaeffb64cad6bae83a33b8c3375d4b86eed3b84ee0c4c7ea8240b690c450f"}
Jul 11 01:11:20.760634 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.760559    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:20.886407 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:20.886386    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"]
Jul 11 01:11:20.888602 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:11:20.888579    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd5a735_30ca_4217_911c_b0d0265fa8ad.slice/crio-29735914a851d928d777a0199ebb980f7b7416ea2383bea8c4e21d22bfc90126 WatchSource:0}: Error finding container 29735914a851d928d777a0199ebb980f7b7416ea2383bea8c4e21d22bfc90126: Status 404 returned error can't find the container with id 29735914a851d928d777a0199ebb980f7b7416ea2383bea8c4e21d22bfc90126
Jul 11 01:11:21.689350 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:21.689242    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn" event={"ID":"6fd5a735-30ca-4217-911c-b0d0265fa8ad","Type":"ContainerStarted","Data":"29735914a851d928d777a0199ebb980f7b7416ea2383bea8c4e21d22bfc90126"}
Jul 11 01:11:21.694547 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:21.694511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"bbf3dda181168bbb3c2b58a67b42a46a8d8e2bce5f530e78797c509372382415"}
Jul 11 01:11:21.694687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:21.694598    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"97ae50bb856c48347f2be4acc57f55355572b61acf82bfd68d8e473fcdd952eb"}
Jul 11 01:11:21.694687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:21.694642    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" event={"ID":"d5648ec6-a20a-4bb5-8686-dcd8e323812b","Type":"ContainerStarted","Data":"9ea00faf4795e7e35817a5cd4116bcf5328bb0f2c9ac6e1942b0194ed4529cdd"}
Jul 11 01:11:21.694823 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:21.694712    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:21.718859 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:21.718803    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz" podStartSLOduration=1.700228361 podStartE2EDuration="4.718780535s" totalImagesPullingTime="3.018552174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:21.716120924 +0000 UTC m=+304.583089476" watchObservedRunningTime="2026-07-11 01:11:21.718780535 +0000 UTC m=+304.585749085"
Jul 11 01:11:22.699511 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:22.699468    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn" event={"ID":"6fd5a735-30ca-4217-911c-b0d0265fa8ad","Type":"ContainerStarted","Data":"7147bc1a62090f87834cbbcfe3cc6939b71b2544f47560407066e72b0f915a18"}
Jul 11 01:11:22.699932 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:22.699799    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:22.704287 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:22.704261    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn"
Jul 11 01:11:22.730302 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:22.730188    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-j5vjn" podStartSLOduration=1.15350038 podStartE2EDuration="2.730170771s" totalImagesPullingTime="1.576670391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:11:22.713552331 +0000 UTC m=+305.580520879" watchObservedRunningTime="2026-07-11 01:11:22.730170771 +0000 UTC m=+305.597139321"
Jul 11 01:11:27.705653 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:27.705621    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cf5f7967f-4smsz"
Jul 11 01:11:30.693441 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:30.693402    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:11:49.798481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:49.798449    2555 generic.go:356] "Generic (PLEG): container finished" podID="11719803-2ed2-4d47-b2dd-acfdd82c7451" containerID="e784f4e518c0d56198e603080e54737863cabe8cff687f8668f2c8fa0e6eef96" exitCode=0
Jul 11 01:11:49.798971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:49.798506    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz" event={"ID":"11719803-2ed2-4d47-b2dd-acfdd82c7451","Type":"ContainerDied","Data":"e784f4e518c0d56198e603080e54737863cabe8cff687f8668f2c8fa0e6eef96"}
Jul 11 01:11:49.798971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:49.798837    2555 scope.go:117] "RemoveContainer" containerID="e784f4e518c0d56198e603080e54737863cabe8cff687f8668f2c8fa0e6eef96"
Jul 11 01:11:50.804172 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:11:50.804134    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ktqfz" event={"ID":"11719803-2ed2-4d47-b2dd-acfdd82c7451","Type":"ContainerStarted","Data":"91ae2f3747c306fd1fb0ecac0968fa057402394d6cd8baee30596fa10d3cf3f9"}
Jul 11 01:12:31.469009 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:31.468920    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:12:31.471169 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:31.471148    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69707e06-c807-4a84-97ad-92925e8f1656-metrics-certs\") pod \"network-metrics-daemon-5rltd\" (UID: \"69707e06-c807-4a84-97ad-92925e8f1656\") " pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:12:31.597120 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:31.597093    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ms55\""
Jul 11 01:12:31.604996 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:31.604969    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rltd"
Jul 11 01:12:31.732310 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:31.732227    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rltd"]
Jul 11 01:12:31.736311 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:12:31.736287    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69707e06_c807_4a84_97ad_92925e8f1656.slice/crio-57a40689b615c141aa2a47dc61d33d433161d6da38986546f08ed6173db2ec9a WatchSource:0}: Error finding container 57a40689b615c141aa2a47dc61d33d433161d6da38986546f08ed6173db2ec9a: Status 404 returned error can't find the container with id 57a40689b615c141aa2a47dc61d33d433161d6da38986546f08ed6173db2ec9a
Jul 11 01:12:31.953628 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:31.953593    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rltd" event={"ID":"69707e06-c807-4a84-97ad-92925e8f1656","Type":"ContainerStarted","Data":"57a40689b615c141aa2a47dc61d33d433161d6da38986546f08ed6173db2ec9a"}
Jul 11 01:12:32.958610 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:32.958521    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rltd" event={"ID":"69707e06-c807-4a84-97ad-92925e8f1656","Type":"ContainerStarted","Data":"9548638dd9cc00ae7c7e1642c31622225bb545afbfa7e42494d15a20165ab13a"}
Jul 11 01:12:32.958610 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:32.958573    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rltd" event={"ID":"69707e06-c807-4a84-97ad-92925e8f1656","Type":"ContainerStarted","Data":"20f94581fa249b7e81fc7a5f8b86937a2524ef147df3f8fa312c40a2e3d2f1c8"}
Jul 11 01:12:32.973742 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:12:32.973696    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5rltd" podStartSLOduration=373.06761264 podStartE2EDuration="6m13.973681766s" totalImagesPullingTime="906.069126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:12:32.973416281 +0000 UTC m=+375.840384842" watchObservedRunningTime="2026-07-11 01:12:32.973681766 +0000 UTC m=+375.840650328"
Jul 11 01:14:35.957841 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.957806    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"]
Jul 11 01:14:35.961251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.961234    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:35.963918 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.963897    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 11 01:14:35.964028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.963976    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 11 01:14:35.964938 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.964921    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zb4k2\""
Jul 11 01:14:35.971380 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.971354    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"]
Jul 11 01:14:35.998966 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.998942    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:35.999095 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.999003    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlfkt\" (UniqueName: \"kubernetes.io/projected/5ef784b0-65a1-4d03-98f2-2831c40d277b-kube-api-access-rlfkt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:35.999095 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:35.999038    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.099495 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.099459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.099671 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.099506    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlfkt\" (UniqueName: \"kubernetes.io/projected/5ef784b0-65a1-4d03-98f2-2831c40d277b-kube-api-access-rlfkt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.099671 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.099559    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.099912 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.099893    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.100017 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.099951    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.109152 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.109129    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlfkt\" (UniqueName: \"kubernetes.io/projected/5ef784b0-65a1-4d03-98f2-2831c40d277b-kube-api-access-rlfkt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.269974 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.269890    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:36.395840 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.395812    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"]
Jul 11 01:14:36.400785 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:14:36.400758    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef784b0_65a1_4d03_98f2_2831c40d277b.slice/crio-e3274601f0e811256bd0d61c25f383ff2fbd730303cee2c37235ba5ece12f1fa WatchSource:0}: Error finding container e3274601f0e811256bd0d61c25f383ff2fbd730303cee2c37235ba5ece12f1fa: Status 404 returned error can't find the container with id e3274601f0e811256bd0d61c25f383ff2fbd730303cee2c37235ba5ece12f1fa
Jul 11 01:14:36.414506 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:36.414476    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh" event={"ID":"5ef784b0-65a1-4d03-98f2-2831c40d277b","Type":"ContainerStarted","Data":"e3274601f0e811256bd0d61c25f383ff2fbd730303cee2c37235ba5ece12f1fa"}
Jul 11 01:14:45.451659 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:45.451617    2555 generic.go:356] "Generic (PLEG): container finished" podID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerID="2d4e7a4694af233cb3299ae7c6f911ec38ff0cc51ab0342362547f4545b9a633" exitCode=0
Jul 11 01:14:45.452103 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:45.451696    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh" event={"ID":"5ef784b0-65a1-4d03-98f2-2831c40d277b","Type":"ContainerDied","Data":"2d4e7a4694af233cb3299ae7c6f911ec38ff0cc51ab0342362547f4545b9a633"}
Jul 11 01:14:48.465012 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:48.464973    2555 generic.go:356] "Generic (PLEG): container finished" podID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerID="d0e6b6350f752211ba9479b06265323408a62c7b4993036fd1e545417ef94dbf" exitCode=0
Jul 11 01:14:48.465406 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:48.465055    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh" event={"ID":"5ef784b0-65a1-4d03-98f2-2831c40d277b","Type":"ContainerDied","Data":"d0e6b6350f752211ba9479b06265323408a62c7b4993036fd1e545417ef94dbf"}
Jul 11 01:14:57.503805 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:57.503771    2555 generic.go:356] "Generic (PLEG): container finished" podID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerID="8966f58de3b1e7fc1f3ca78f0d9a995575cfb7a69c28add9c1f0a2e10bf83048" exitCode=0
Jul 11 01:14:57.504191 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:57.503827    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh" event={"ID":"5ef784b0-65a1-4d03-98f2-2831c40d277b","Type":"ContainerDied","Data":"8966f58de3b1e7fc1f3ca78f0d9a995575cfb7a69c28add9c1f0a2e10bf83048"}
Jul 11 01:14:58.666921 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.666888    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:58.785485 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.785458    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-util\") pod \"5ef784b0-65a1-4d03-98f2-2831c40d277b\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") "
Jul 11 01:14:58.785644 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.785495    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlfkt\" (UniqueName: \"kubernetes.io/projected/5ef784b0-65a1-4d03-98f2-2831c40d277b-kube-api-access-rlfkt\") pod \"5ef784b0-65a1-4d03-98f2-2831c40d277b\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") "
Jul 11 01:14:58.785644 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.785558    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-bundle\") pod \"5ef784b0-65a1-4d03-98f2-2831c40d277b\" (UID: \"5ef784b0-65a1-4d03-98f2-2831c40d277b\") "
Jul 11 01:14:58.786254 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.786225    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-bundle" (OuterVolumeSpecName: "bundle") pod "5ef784b0-65a1-4d03-98f2-2831c40d277b" (UID: "5ef784b0-65a1-4d03-98f2-2831c40d277b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:14:58.787735 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.787716    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef784b0-65a1-4d03-98f2-2831c40d277b-kube-api-access-rlfkt" (OuterVolumeSpecName: "kube-api-access-rlfkt") pod "5ef784b0-65a1-4d03-98f2-2831c40d277b" (UID: "5ef784b0-65a1-4d03-98f2-2831c40d277b"). InnerVolumeSpecName "kube-api-access-rlfkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:14:58.789733 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.789706    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-util" (OuterVolumeSpecName: "util") pod "5ef784b0-65a1-4d03-98f2-2831c40d277b" (UID: "5ef784b0-65a1-4d03-98f2-2831c40d277b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:14:58.886954 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.886921    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlfkt\" (UniqueName: \"kubernetes.io/projected/5ef784b0-65a1-4d03-98f2-2831c40d277b-kube-api-access-rlfkt\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:14:58.886954 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.886948    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:14:58.886954 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:58.886957    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ef784b0-65a1-4d03-98f2-2831c40d277b-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:14:59.513476 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:59.513447    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh"
Jul 11 01:14:59.513476 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:59.513460    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dpfbh" event={"ID":"5ef784b0-65a1-4d03-98f2-2831c40d277b","Type":"ContainerDied","Data":"e3274601f0e811256bd0d61c25f383ff2fbd730303cee2c37235ba5ece12f1fa"}
Jul 11 01:14:59.513668 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:14:59.513500    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3274601f0e811256bd0d61c25f383ff2fbd730303cee2c37235ba5ece12f1fa"
Jul 11 01:15:06.991666 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991628    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"]
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991904    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="util"
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991914    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="util"
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991921    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="pull"
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991926    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="pull"
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991935    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="extract"
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991941    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="extract"
Jul 11 01:15:06.992138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.991994    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef784b0-65a1-4d03-98f2-2831c40d277b" containerName="extract"
Jul 11 01:15:06.993977 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.993961    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:06.996773 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.996753    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 11 01:15:06.996905 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.996840    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9jfnr\""
Jul 11 01:15:06.997080 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:06.997065    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:15:07.017573 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.017547    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"]
Jul 11 01:15:07.152123 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.152081    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d34d9bd-43b5-42ab-a2f9-d73fed1cc701-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6nc4g\" (UID: \"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.152337 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.152193    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7xg\" (UniqueName: \"kubernetes.io/projected/2d34d9bd-43b5-42ab-a2f9-d73fed1cc701-kube-api-access-cs7xg\") pod \"cert-manager-operator-controller-manager-55c444bf86-6nc4g\" (UID: \"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.253562 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.253471    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d34d9bd-43b5-42ab-a2f9-d73fed1cc701-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6nc4g\" (UID: \"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.253562 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.253523    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7xg\" (UniqueName: \"kubernetes.io/projected/2d34d9bd-43b5-42ab-a2f9-d73fed1cc701-kube-api-access-cs7xg\") pod \"cert-manager-operator-controller-manager-55c444bf86-6nc4g\" (UID: \"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.253853 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.253828    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d34d9bd-43b5-42ab-a2f9-d73fed1cc701-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6nc4g\" (UID: \"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.260945 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.260914    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7xg\" (UniqueName: \"kubernetes.io/projected/2d34d9bd-43b5-42ab-a2f9-d73fed1cc701-kube-api-access-cs7xg\") pod \"cert-manager-operator-controller-manager-55c444bf86-6nc4g\" (UID: \"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.303064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.303033    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"
Jul 11 01:15:07.431877 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.431848    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g"]
Jul 11 01:15:07.435499 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:07.435474    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d34d9bd_43b5_42ab_a2f9_d73fed1cc701.slice/crio-3b997f432325c282687b9c0859f0082ca0ecf6ffa71b9f0cc28b30696a6e101c WatchSource:0}: Error finding container 3b997f432325c282687b9c0859f0082ca0ecf6ffa71b9f0cc28b30696a6e101c: Status 404 returned error can't find the container with id 3b997f432325c282687b9c0859f0082ca0ecf6ffa71b9f0cc28b30696a6e101c
Jul 11 01:15:07.543300 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:07.543266    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g" event={"ID":"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701","Type":"ContainerStarted","Data":"3b997f432325c282687b9c0859f0082ca0ecf6ffa71b9f0cc28b30696a6e101c"}
Jul 11 01:15:09.556081 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:09.556046    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g" event={"ID":"2d34d9bd-43b5-42ab-a2f9-d73fed1cc701","Type":"ContainerStarted","Data":"66c26ee1cfa646d7a9c91ade5a52d0ada746367ff7b3096f4cc93e6a0765f275"}
Jul 11 01:15:09.584284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:09.584190    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6nc4g" podStartSLOduration=1.9882679159999999 podStartE2EDuration="3.584166903s" totalImagesPullingTime="1.595898987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:09.582724364 +0000 UTC m=+532.449692913" watchObservedRunningTime="2026-07-11 01:15:09.584166903 +0000 UTC m=+532.451135454"
Jul 11 01:15:10.678158 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.678125    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"]
Jul 11 01:15:10.680536 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.680512    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.683216 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.683176    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zb4k2\""
Jul 11 01:15:10.683318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.683241    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 11 01:15:10.684224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.684192    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 11 01:15:10.691331 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.691311    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"]
Jul 11 01:15:10.785826 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.785779    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.786010 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.785852    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdw5b\" (UniqueName: \"kubernetes.io/projected/054dd0e4-e90f-461d-a3c9-b9b9365f376a-kube-api-access-xdw5b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.786010 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.785892    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.886790 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.886748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdw5b\" (UniqueName: \"kubernetes.io/projected/054dd0e4-e90f-461d-a3c9-b9b9365f376a-kube-api-access-xdw5b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.886997 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.886805    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.886997 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.886881    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.887255 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.887194    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.887343 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.887279    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.897753 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.897722    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdw5b\" (UniqueName: \"kubernetes.io/projected/054dd0e4-e90f-461d-a3c9-b9b9365f376a-kube-api-access-xdw5b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:10.990843 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:10.990765    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:11.115450 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:11.115419    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"]
Jul 11 01:15:11.118572 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:11.118546    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054dd0e4_e90f_461d_a3c9_b9b9365f376a.slice/crio-23f4e3b06b42d41610d877578b4641cf626008f4cbd0da173c042db8052d6292 WatchSource:0}: Error finding container 23f4e3b06b42d41610d877578b4641cf626008f4cbd0da173c042db8052d6292: Status 404 returned error can't find the container with id 23f4e3b06b42d41610d877578b4641cf626008f4cbd0da173c042db8052d6292
Jul 11 01:15:11.565351 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:11.565311    2555 generic.go:356] "Generic (PLEG): container finished" podID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerID="6f17543d4c822270d0fcb72118910ad53d34fd03a7b1b507eccc459e11971c5d" exitCode=0
Jul 11 01:15:11.565502 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:11.565352    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n" event={"ID":"054dd0e4-e90f-461d-a3c9-b9b9365f376a","Type":"ContainerDied","Data":"6f17543d4c822270d0fcb72118910ad53d34fd03a7b1b507eccc459e11971c5d"}
Jul 11 01:15:11.565502 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:11.565402    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n" event={"ID":"054dd0e4-e90f-461d-a3c9-b9b9365f376a","Type":"ContainerStarted","Data":"23f4e3b06b42d41610d877578b4641cf626008f4cbd0da173c042db8052d6292"}
Jul 11 01:15:13.576008 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.575979    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n" event={"ID":"054dd0e4-e90f-461d-a3c9-b9b9365f376a","Type":"ContainerStarted","Data":"c4202e30b6c622a53187d90d7037934fc6519401c16b252bbad1baa4311df8e6"}
Jul 11 01:15:13.643695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.643668    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2b74k"]
Jul 11 01:15:13.646628 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.646612    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.649104 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.649079    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ksgpt\""
Jul 11 01:15:13.649234 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.649116    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 11 01:15:13.649234 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.649146    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 11 01:15:13.653819 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.653796    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2b74k"]
Jul 11 01:15:13.810941 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.810905    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzxcs\" (UniqueName: \"kubernetes.io/projected/af32c9c9-e7e2-4078-90a5-2da89a8a41e8-kube-api-access-zzxcs\") pod \"cert-manager-webhook-6486ffd997-2b74k\" (UID: \"af32c9c9-e7e2-4078-90a5-2da89a8a41e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.810941 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.810958    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af32c9c9-e7e2-4078-90a5-2da89a8a41e8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2b74k\" (UID: \"af32c9c9-e7e2-4078-90a5-2da89a8a41e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.912102 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.912062    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af32c9c9-e7e2-4078-90a5-2da89a8a41e8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2b74k\" (UID: \"af32c9c9-e7e2-4078-90a5-2da89a8a41e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.912316 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.912157    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzxcs\" (UniqueName: \"kubernetes.io/projected/af32c9c9-e7e2-4078-90a5-2da89a8a41e8-kube-api-access-zzxcs\") pod \"cert-manager-webhook-6486ffd997-2b74k\" (UID: \"af32c9c9-e7e2-4078-90a5-2da89a8a41e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.920138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.920098    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af32c9c9-e7e2-4078-90a5-2da89a8a41e8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2b74k\" (UID: \"af32c9c9-e7e2-4078-90a5-2da89a8a41e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.920299 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.920258    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzxcs\" (UniqueName: \"kubernetes.io/projected/af32c9c9-e7e2-4078-90a5-2da89a8a41e8-kube-api-access-zzxcs\") pod \"cert-manager-webhook-6486ffd997-2b74k\" (UID: \"af32c9c9-e7e2-4078-90a5-2da89a8a41e8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:13.993018 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:13.992981    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:14.119101 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:14.119069    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2b74k"]
Jul 11 01:15:14.121818 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:14.121798    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf32c9c9_e7e2_4078_90a5_2da89a8a41e8.slice/crio-b2e9004a2a4f67a055c6e1199ce241ff98833e193b2196c6b41d194b55605de9 WatchSource:0}: Error finding container b2e9004a2a4f67a055c6e1199ce241ff98833e193b2196c6b41d194b55605de9: Status 404 returned error can't find the container with id b2e9004a2a4f67a055c6e1199ce241ff98833e193b2196c6b41d194b55605de9
Jul 11 01:15:14.581773 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:14.581738    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k" event={"ID":"af32c9c9-e7e2-4078-90a5-2da89a8a41e8","Type":"ContainerStarted","Data":"b2e9004a2a4f67a055c6e1199ce241ff98833e193b2196c6b41d194b55605de9"}
Jul 11 01:15:14.583487 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:14.583461    2555 generic.go:356] "Generic (PLEG): container finished" podID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerID="c4202e30b6c622a53187d90d7037934fc6519401c16b252bbad1baa4311df8e6" exitCode=0
Jul 11 01:15:14.583628 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:14.583519    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n" event={"ID":"054dd0e4-e90f-461d-a3c9-b9b9365f376a","Type":"ContainerDied","Data":"c4202e30b6c622a53187d90d7037934fc6519401c16b252bbad1baa4311df8e6"}
Jul 11 01:15:15.591674 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:15.591630    2555 generic.go:356] "Generic (PLEG): container finished" podID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerID="9236ce67fe2229ab5625914356dda233a0dc77962981b61abb50650d6ba79260" exitCode=0
Jul 11 01:15:15.592108 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:15.591717    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n" event={"ID":"054dd0e4-e90f-461d-a3c9-b9b9365f376a","Type":"ContainerDied","Data":"9236ce67fe2229ab5625914356dda233a0dc77962981b61abb50650d6ba79260"}
Jul 11 01:15:17.455845 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.455818    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:17.543902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.543880    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-bundle\") pod \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") "
Jul 11 01:15:17.544018 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.543908    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-util\") pod \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") "
Jul 11 01:15:17.544018 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.543926    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdw5b\" (UniqueName: \"kubernetes.io/projected/054dd0e4-e90f-461d-a3c9-b9b9365f376a-kube-api-access-xdw5b\") pod \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\" (UID: \"054dd0e4-e90f-461d-a3c9-b9b9365f376a\") "
Jul 11 01:15:17.544295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.544268    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-bundle" (OuterVolumeSpecName: "bundle") pod "054dd0e4-e90f-461d-a3c9-b9b9365f376a" (UID: "054dd0e4-e90f-461d-a3c9-b9b9365f376a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:15:17.546129 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.546102    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054dd0e4-e90f-461d-a3c9-b9b9365f376a-kube-api-access-xdw5b" (OuterVolumeSpecName: "kube-api-access-xdw5b") pod "054dd0e4-e90f-461d-a3c9-b9b9365f376a" (UID: "054dd0e4-e90f-461d-a3c9-b9b9365f376a"). InnerVolumeSpecName "kube-api-access-xdw5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:15:17.549844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.549803    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-util" (OuterVolumeSpecName: "util") pod "054dd0e4-e90f-461d-a3c9-b9b9365f376a" (UID: "054dd0e4-e90f-461d-a3c9-b9b9365f376a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:15:17.607524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.607475    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n" event={"ID":"054dd0e4-e90f-461d-a3c9-b9b9365f376a","Type":"ContainerDied","Data":"23f4e3b06b42d41610d877578b4641cf626008f4cbd0da173c042db8052d6292"}
Jul 11 01:15:17.607692 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.607565    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23f4e3b06b42d41610d877578b4641cf626008f4cbd0da173c042db8052d6292"
Jul 11 01:15:17.607692 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.607496    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd5m9n"
Jul 11 01:15:17.609064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.609038    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k" event={"ID":"af32c9c9-e7e2-4078-90a5-2da89a8a41e8","Type":"ContainerStarted","Data":"30aab43299e39ce6bf3e203d2c865021d7bf13e9d156080c36aab655144b8431"}
Jul 11 01:15:17.609185 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.609101    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:17.625603 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.625548    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k" podStartSLOduration=1.241480215 podStartE2EDuration="4.625532889s" totalImagesPullingTime="3.384052674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:17.624681224 +0000 UTC m=+540.491649776" watchObservedRunningTime="2026-07-11 01:15:17.625532889 +0000 UTC m=+540.492501441"
Jul 11 01:15:17.645164 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.645132    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:15:17.645164 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.645157    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/054dd0e4-e90f-461d-a3c9-b9b9365f376a-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:15:17.645324 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:17.645167    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdw5b\" (UniqueName: \"kubernetes.io/projected/054dd0e4-e90f-461d-a3c9-b9b9365f376a-kube-api-access-xdw5b\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:15:23.614918 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:23.614882    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2b74k"
Jul 11 01:15:28.876594 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876559    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"]
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876841    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="pull"
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876851    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="pull"
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876863    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="extract"
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876870    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="extract"
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876880    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="util"
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876885    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="util"
Jul 11 01:15:28.877035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.876935    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="054dd0e4-e90f-461d-a3c9-b9b9365f376a" containerName="extract"
Jul 11 01:15:28.921979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.921948    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"]
Jul 11 01:15:28.922124 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.922041    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:28.924973 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.924950    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5jlr5\""
Jul 11 01:15:28.925100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.924996    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 11 01:15:28.926246 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:28.926231    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 11 01:15:29.028339 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.028299    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7892b3f6-f1eb-40de-9dc8-c34aea483865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5dr5v\" (UID: \"7892b3f6-f1eb-40de-9dc8-c34aea483865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.028511 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.028385    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjpc\" (UniqueName: \"kubernetes.io/projected/7892b3f6-f1eb-40de-9dc8-c34aea483865-kube-api-access-xfjpc\") pod \"openshift-lws-operator-fd8ccff4c-5dr5v\" (UID: \"7892b3f6-f1eb-40de-9dc8-c34aea483865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.129709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.129624    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjpc\" (UniqueName: \"kubernetes.io/projected/7892b3f6-f1eb-40de-9dc8-c34aea483865-kube-api-access-xfjpc\") pod \"openshift-lws-operator-fd8ccff4c-5dr5v\" (UID: \"7892b3f6-f1eb-40de-9dc8-c34aea483865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.129709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.129681    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7892b3f6-f1eb-40de-9dc8-c34aea483865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5dr5v\" (UID: \"7892b3f6-f1eb-40de-9dc8-c34aea483865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.130040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.130022    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7892b3f6-f1eb-40de-9dc8-c34aea483865-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5dr5v\" (UID: \"7892b3f6-f1eb-40de-9dc8-c34aea483865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.137988 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.137958    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjpc\" (UniqueName: \"kubernetes.io/projected/7892b3f6-f1eb-40de-9dc8-c34aea483865-kube-api-access-xfjpc\") pod \"openshift-lws-operator-fd8ccff4c-5dr5v\" (UID: \"7892b3f6-f1eb-40de-9dc8-c34aea483865\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.231544 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.231508    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"
Jul 11 01:15:29.375396 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.375371    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v"]
Jul 11 01:15:29.377818 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:29.377791    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7892b3f6_f1eb_40de_9dc8_c34aea483865.slice/crio-0ef9ae00ed91c66c61176722b14c82f3d334a8efcd6300d29649dfdcdfdd4c55 WatchSource:0}: Error finding container 0ef9ae00ed91c66c61176722b14c82f3d334a8efcd6300d29649dfdcdfdd4c55: Status 404 returned error can't find the container with id 0ef9ae00ed91c66c61176722b14c82f3d334a8efcd6300d29649dfdcdfdd4c55
Jul 11 01:15:29.658501 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:29.658412    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v" event={"ID":"7892b3f6-f1eb-40de-9dc8-c34aea483865","Type":"ContainerStarted","Data":"0ef9ae00ed91c66c61176722b14c82f3d334a8efcd6300d29649dfdcdfdd4c55"}
Jul 11 01:15:31.298689 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.298648    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nw2dv"]
Jul 11 01:15:31.312298 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.312262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nw2dv"]
Jul 11 01:15:31.312451 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.312357    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.315118 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.315091    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tcgd5\""
Jul 11 01:15:31.349312 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.349278    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pthdp\" (UniqueName: \"kubernetes.io/projected/82dc16cb-a5f7-4369-b6e1-bed5b271c632-kube-api-access-pthdp\") pod \"cert-manager-55b4d954d5-nw2dv\" (UID: \"82dc16cb-a5f7-4369-b6e1-bed5b271c632\") " pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.349457 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.349326    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82dc16cb-a5f7-4369-b6e1-bed5b271c632-bound-sa-token\") pod \"cert-manager-55b4d954d5-nw2dv\" (UID: \"82dc16cb-a5f7-4369-b6e1-bed5b271c632\") " pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.450723 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.450690    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82dc16cb-a5f7-4369-b6e1-bed5b271c632-bound-sa-token\") pod \"cert-manager-55b4d954d5-nw2dv\" (UID: \"82dc16cb-a5f7-4369-b6e1-bed5b271c632\") " pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.450882 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.450775    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pthdp\" (UniqueName: \"kubernetes.io/projected/82dc16cb-a5f7-4369-b6e1-bed5b271c632-kube-api-access-pthdp\") pod \"cert-manager-55b4d954d5-nw2dv\" (UID: \"82dc16cb-a5f7-4369-b6e1-bed5b271c632\") " pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.459016 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.458992    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82dc16cb-a5f7-4369-b6e1-bed5b271c632-bound-sa-token\") pod \"cert-manager-55b4d954d5-nw2dv\" (UID: \"82dc16cb-a5f7-4369-b6e1-bed5b271c632\") " pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.459126 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.459105    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pthdp\" (UniqueName: \"kubernetes.io/projected/82dc16cb-a5f7-4369-b6e1-bed5b271c632-kube-api-access-pthdp\") pod \"cert-manager-55b4d954d5-nw2dv\" (UID: \"82dc16cb-a5f7-4369-b6e1-bed5b271c632\") " pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.622640 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.622610    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nw2dv"
Jul 11 01:15:31.762860 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:31.762834    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nw2dv"]
Jul 11 01:15:31.765822 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:31.765792    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82dc16cb_a5f7_4369_b6e1_bed5b271c632.slice/crio-66d10c110fe3cf0302b6fddb12a3cd666b88a85e1f1dc1273c5d1f831a5c7ea2 WatchSource:0}: Error finding container 66d10c110fe3cf0302b6fddb12a3cd666b88a85e1f1dc1273c5d1f831a5c7ea2: Status 404 returned error can't find the container with id 66d10c110fe3cf0302b6fddb12a3cd666b88a85e1f1dc1273c5d1f831a5c7ea2
Jul 11 01:15:32.673403 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:32.673362    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nw2dv" event={"ID":"82dc16cb-a5f7-4369-b6e1-bed5b271c632","Type":"ContainerStarted","Data":"262038044dc49caf6df8d89c5712caec331d30d3892ad393d9fec0a2c9e5a60b"}
Jul 11 01:15:32.673843 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:32.673416    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nw2dv" event={"ID":"82dc16cb-a5f7-4369-b6e1-bed5b271c632","Type":"ContainerStarted","Data":"66d10c110fe3cf0302b6fddb12a3cd666b88a85e1f1dc1273c5d1f831a5c7ea2"}
Jul 11 01:15:32.675094 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:32.675067    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v" event={"ID":"7892b3f6-f1eb-40de-9dc8-c34aea483865","Type":"ContainerStarted","Data":"1807da50bc93befa91782b8767512743a77e818537d81e398478d3e7ae2ecf84"}
Jul 11 01:15:32.688898 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:32.688840    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nw2dv" podStartSLOduration=1.6888214860000001 podStartE2EDuration="1.688821486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:32.687910375 +0000 UTC m=+555.554878925" watchObservedRunningTime="2026-07-11 01:15:32.688821486 +0000 UTC m=+555.555790040"
Jul 11 01:15:36.735527 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.735477    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5dr5v" podStartSLOduration=6.512453868 podStartE2EDuration="8.735460685s" totalImagesPullingTime="2.223006817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:32.703958322 +0000 UTC m=+555.570926873" watchObservedRunningTime="2026-07-11 01:15:36.735460685 +0000 UTC m=+559.602429272"
Jul 11 01:15:36.736404 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.736385    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"]
Jul 11 01:15:36.738721 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.738704    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.741823 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.741804    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 11 01:15:36.742968 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.742949    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 11 01:15:36.743030 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.742953    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-zb4k2\""
Jul 11 01:15:36.751940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.751915    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"]
Jul 11 01:15:36.793193 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.793155    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.793390 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.793197    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.793390 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.793250    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bg2j\" (UniqueName: \"kubernetes.io/projected/5738e1bb-62f3-4a4f-8320-95231c9273dc-kube-api-access-8bg2j\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.894480 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.894443    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.894667 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.894495    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.894738 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.894692    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bg2j\" (UniqueName: \"kubernetes.io/projected/5738e1bb-62f3-4a4f-8320-95231c9273dc-kube-api-access-8bg2j\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.894829 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.894809    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.894879 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.894860    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:36.902425 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:36.902404    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bg2j\" (UniqueName: \"kubernetes.io/projected/5738e1bb-62f3-4a4f-8320-95231c9273dc-kube-api-access-8bg2j\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:37.048475 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:37.048438    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:37.210279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:37.210255    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"]
Jul 11 01:15:37.212990 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:37.212959    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5738e1bb_62f3_4a4f_8320_95231c9273dc.slice/crio-c6ba2fd387cc054bb6c58d22b3a3782b900d6f62b881092c0583d6ae6168406e WatchSource:0}: Error finding container c6ba2fd387cc054bb6c58d22b3a3782b900d6f62b881092c0583d6ae6168406e: Status 404 returned error can't find the container with id c6ba2fd387cc054bb6c58d22b3a3782b900d6f62b881092c0583d6ae6168406e
Jul 11 01:15:37.698786 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:37.698691    2555 generic.go:356] "Generic (PLEG): container finished" podID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerID="772d0e473d01d9b33c116930f74c6c8b4b26f2eb2109274987b442e32c63027b" exitCode=0
Jul 11 01:15:37.698786 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:37.698745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz" event={"ID":"5738e1bb-62f3-4a4f-8320-95231c9273dc","Type":"ContainerDied","Data":"772d0e473d01d9b33c116930f74c6c8b4b26f2eb2109274987b442e32c63027b"}
Jul 11 01:15:37.698786 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:37.698782    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz" event={"ID":"5738e1bb-62f3-4a4f-8320-95231c9273dc","Type":"ContainerStarted","Data":"c6ba2fd387cc054bb6c58d22b3a3782b900d6f62b881092c0583d6ae6168406e"}
Jul 11 01:15:38.704571 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:38.704479    2555 generic.go:356] "Generic (PLEG): container finished" podID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerID="dec4138ca4171736711278df727bafd55096e6b92d101b3b3cefd1d0547c353e" exitCode=0
Jul 11 01:15:38.704957 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:38.704578    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz" event={"ID":"5738e1bb-62f3-4a4f-8320-95231c9273dc","Type":"ContainerDied","Data":"dec4138ca4171736711278df727bafd55096e6b92d101b3b3cefd1d0547c353e"}
Jul 11 01:15:39.711215 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:39.711176    2555 generic.go:356] "Generic (PLEG): container finished" podID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerID="651bd95ea259a49e628ca995d3797d0706148e0089ebfca6749a854cf6d63548" exitCode=0
Jul 11 01:15:39.711606 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:39.711263    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz" event={"ID":"5738e1bb-62f3-4a4f-8320-95231c9273dc","Type":"ContainerDied","Data":"651bd95ea259a49e628ca995d3797d0706148e0089ebfca6749a854cf6d63548"}
Jul 11 01:15:40.835985 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.835961    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:40.928847 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.928811    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-bundle\") pod \"5738e1bb-62f3-4a4f-8320-95231c9273dc\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") "
Jul 11 01:15:40.929041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.928874    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bg2j\" (UniqueName: \"kubernetes.io/projected/5738e1bb-62f3-4a4f-8320-95231c9273dc-kube-api-access-8bg2j\") pod \"5738e1bb-62f3-4a4f-8320-95231c9273dc\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") "
Jul 11 01:15:40.929041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.928904    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-util\") pod \"5738e1bb-62f3-4a4f-8320-95231c9273dc\" (UID: \"5738e1bb-62f3-4a4f-8320-95231c9273dc\") "
Jul 11 01:15:40.929672 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.929645    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-bundle" (OuterVolumeSpecName: "bundle") pod "5738e1bb-62f3-4a4f-8320-95231c9273dc" (UID: "5738e1bb-62f3-4a4f-8320-95231c9273dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:15:40.930947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.930919    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5738e1bb-62f3-4a4f-8320-95231c9273dc-kube-api-access-8bg2j" (OuterVolumeSpecName: "kube-api-access-8bg2j") pod "5738e1bb-62f3-4a4f-8320-95231c9273dc" (UID: "5738e1bb-62f3-4a4f-8320-95231c9273dc"). InnerVolumeSpecName "kube-api-access-8bg2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:15:40.934294 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:40.934272    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-util" (OuterVolumeSpecName: "util") pod "5738e1bb-62f3-4a4f-8320-95231c9273dc" (UID: "5738e1bb-62f3-4a4f-8320-95231c9273dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:15:41.030016 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:41.029989    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:15:41.030016 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:41.030016    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bg2j\" (UniqueName: \"kubernetes.io/projected/5738e1bb-62f3-4a4f-8320-95231c9273dc-kube-api-access-8bg2j\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:15:41.030191 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:41.030026    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5738e1bb-62f3-4a4f-8320-95231c9273dc-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:15:41.721416 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:41.721378    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz" event={"ID":"5738e1bb-62f3-4a4f-8320-95231c9273dc","Type":"ContainerDied","Data":"c6ba2fd387cc054bb6c58d22b3a3782b900d6f62b881092c0583d6ae6168406e"}
Jul 11 01:15:41.721416 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:41.721405    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp2txz"
Jul 11 01:15:41.721416 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:41.721425    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6ba2fd387cc054bb6c58d22b3a3782b900d6f62b881092c0583d6ae6168406e"
Jul 11 01:15:48.995587 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995555    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"]
Jul 11 01:15:48.995963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995864    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="extract"
Jul 11 01:15:48.995963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995877    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="extract"
Jul 11 01:15:48.995963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995891    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="util"
Jul 11 01:15:48.995963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995896    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="util"
Jul 11 01:15:48.995963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995905    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="pull"
Jul 11 01:15:48.995963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995910    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="pull"
Jul 11 01:15:48.996144 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.995967    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5738e1bb-62f3-4a4f-8320-95231c9273dc" containerName="extract"
Jul 11 01:15:48.998091 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:48.998075    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.000755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.000728    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 11 01:15:49.000887 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.000833    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 11 01:15:49.000964 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.000944    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 11 01:15:49.001216 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.001182    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 11 01:15:49.001324 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.001255    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ppx5t\""
Jul 11 01:15:49.016614 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.016584    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"]
Jul 11 01:15:49.096452 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.096412    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1add6ff3-1f90-47d2-a702-0819c34b0667-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.096618 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.096458    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1add6ff3-1f90-47d2-a702-0819c34b0667-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.096618 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.096482    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1add6ff3-1f90-47d2-a702-0819c34b0667-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.096618 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.096553    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k97z7\" (UniqueName: \"kubernetes.io/projected/1add6ff3-1f90-47d2-a702-0819c34b0667-kube-api-access-k97z7\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.096618 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.096572    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1add6ff3-1f90-47d2-a702-0819c34b0667-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.197298 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.197249    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k97z7\" (UniqueName: \"kubernetes.io/projected/1add6ff3-1f90-47d2-a702-0819c34b0667-kube-api-access-k97z7\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.197298 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.197302    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1add6ff3-1f90-47d2-a702-0819c34b0667-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.197510 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.197475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1add6ff3-1f90-47d2-a702-0819c34b0667-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.197549 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.197535    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1add6ff3-1f90-47d2-a702-0819c34b0667-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.197597 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.197579    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1add6ff3-1f90-47d2-a702-0819c34b0667-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.197901 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.197881    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1add6ff3-1f90-47d2-a702-0819c34b0667-manifests\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.199634 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.199610    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1add6ff3-1f90-47d2-a702-0819c34b0667-tmp\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.199755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.199690    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1add6ff3-1f90-47d2-a702-0819c34b0667-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.199833 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.199811    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1add6ff3-1f90-47d2-a702-0819c34b0667-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.204967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.204947    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k97z7\" (UniqueName: \"kubernetes.io/projected/1add6ff3-1f90-47d2-a702-0819c34b0667-kube-api-access-k97z7\") pod \"opendatahub-operator-controller-manager-68fcd49758-m9445\" (UID: \"1add6ff3-1f90-47d2-a702-0819c34b0667\") " pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.309289 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.309249    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:49.446690 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.446618    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"]
Jul 11 01:15:49.449259 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:15:49.449228    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1add6ff3_1f90_47d2_a702_0819c34b0667.slice/crio-eead587a7253c1c5848298cfd4b37624486dd2ec330ceb336c3f0b249b7bc53f WatchSource:0}: Error finding container eead587a7253c1c5848298cfd4b37624486dd2ec330ceb336c3f0b249b7bc53f: Status 404 returned error can't find the container with id eead587a7253c1c5848298cfd4b37624486dd2ec330ceb336c3f0b249b7bc53f
Jul 11 01:15:49.757567 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:49.757480    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445" event={"ID":"1add6ff3-1f90-47d2-a702-0819c34b0667","Type":"ContainerStarted","Data":"eead587a7253c1c5848298cfd4b37624486dd2ec330ceb336c3f0b249b7bc53f"}
Jul 11 01:15:52.776576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:52.776486    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445" event={"ID":"1add6ff3-1f90-47d2-a702-0819c34b0667","Type":"ContainerStarted","Data":"0a716ad00dad54922aa8a6cbc9e32f2580621131ff86f9f67beba869ea6f58a7"}
Jul 11 01:15:53.782852 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:53.782818    2555 generic.go:356] "Generic (PLEG): container finished" podID="1add6ff3-1f90-47d2-a702-0819c34b0667" containerID="0a716ad00dad54922aa8a6cbc9e32f2580621131ff86f9f67beba869ea6f58a7" exitCode=0
Jul 11 01:15:53.783256 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:53.782907    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445" event={"ID":"1add6ff3-1f90-47d2-a702-0819c34b0667","Type":"ContainerDied","Data":"0a716ad00dad54922aa8a6cbc9e32f2580621131ff86f9f67beba869ea6f58a7"}
Jul 11 01:15:54.789287 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:54.789253    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445" event={"ID":"1add6ff3-1f90-47d2-a702-0819c34b0667","Type":"ContainerStarted","Data":"fd27512fb75c7b617c482d1508f8bae0de46472ea443abe14d4d9e5ce6cb1949"}
Jul 11 01:15:54.789713 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:54.789409    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:15:54.810814 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:15:54.810768    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445" podStartSLOduration=2.497315943 podStartE2EDuration="6.810754016s" totalImagesPullingTime="3.262872068s" totalInitContainerRuntime="1.050566005s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:15:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:15:54.808276637 +0000 UTC m=+577.675245188" watchObservedRunningTime="2026-07-11 01:15:54.810754016 +0000 UTC m=+577.677722565"
Jul 11 01:16:05.797528 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:05.797495    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fcd49758-m9445"
Jul 11 01:16:08.506719 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.506686    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"]
Jul 11 01:16:08.516935 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.516906    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.520586 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.520558    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 11 01:16:08.520798 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.520558    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 11 01:16:08.520936 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.520692    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zvm7j\""
Jul 11 01:16:08.522704 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.522682    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"]
Jul 11 01:16:08.606787 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.606753    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kfvn6"]
Jul 11 01:16:08.609112 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.609094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:08.611658 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.611639    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 11 01:16:08.611786 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.611642    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nw4cc\""
Jul 11 01:16:08.619781 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.619756    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kfvn6"]
Jul 11 01:16:08.661813 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.661779    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzzd8\" (UniqueName: \"kubernetes.io/projected/9cdfd765-5040-4995-927f-d8600edf8a8d-kube-api-access-pzzd8\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.661998 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.661828    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cdfd765-5040-4995-927f-d8600edf8a8d-tls-certs\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.661998 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.661935    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cdfd765-5040-4995-927f-d8600edf8a8d-tmp\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.762530 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.762431    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2dd919-8714-4b98-9e55-26e28e7cca13-cert\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:08.762530 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.762495    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cdfd765-5040-4995-927f-d8600edf8a8d-tmp\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.762807 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.762537    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzzd8\" (UniqueName: \"kubernetes.io/projected/9cdfd765-5040-4995-927f-d8600edf8a8d-kube-api-access-pzzd8\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.762807 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.762557    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x826\" (UniqueName: \"kubernetes.io/projected/6a2dd919-8714-4b98-9e55-26e28e7cca13-kube-api-access-5x826\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:08.762807 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.762608    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cdfd765-5040-4995-927f-d8600edf8a8d-tls-certs\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.765259 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.765196    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9cdfd765-5040-4995-927f-d8600edf8a8d-tmp\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.765421 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.765405    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cdfd765-5040-4995-927f-d8600edf8a8d-tls-certs\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.774155 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.774126    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzzd8\" (UniqueName: \"kubernetes.io/projected/9cdfd765-5040-4995-927f-d8600edf8a8d-kube-api-access-pzzd8\") pod \"kube-auth-proxy-57dcd4c987-56wjm\" (UID: \"9cdfd765-5040-4995-927f-d8600edf8a8d\") " pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.829797 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.829754    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"
Jul 11 01:16:08.863879 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.863844    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x826\" (UniqueName: \"kubernetes.io/projected/6a2dd919-8714-4b98-9e55-26e28e7cca13-kube-api-access-5x826\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:08.864188 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.864168    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2dd919-8714-4b98-9e55-26e28e7cca13-cert\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:08.864393 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:16:08.864372    2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 11 01:16:08.864507 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:16:08.864493    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2dd919-8714-4b98-9e55-26e28e7cca13-cert podName:6a2dd919-8714-4b98-9e55-26e28e7cca13 nodeName:}" failed. No retries permitted until 2026-07-11 01:16:09.364471892 +0000 UTC m=+592.231440434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6a2dd919-8714-4b98-9e55-26e28e7cca13-cert") pod "odh-model-controller-7998c67dc4-kfvn6" (UID: "6a2dd919-8714-4b98-9e55-26e28e7cca13") : secret "odh-model-controller-webhook-cert" not found
Jul 11 01:16:08.875009 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.874981    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x826\" (UniqueName: \"kubernetes.io/projected/6a2dd919-8714-4b98-9e55-26e28e7cca13-kube-api-access-5x826\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:08.974000 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:08.973945    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm"]
Jul 11 01:16:08.976491 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:16:08.976463    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdfd765_5040_4995_927f_d8600edf8a8d.slice/crio-dae193045c22352662dd73a02a8f33a8b27824c7f9fdb2e8c40e969ad473abf0 WatchSource:0}: Error finding container dae193045c22352662dd73a02a8f33a8b27824c7f9fdb2e8c40e969ad473abf0: Status 404 returned error can't find the container with id dae193045c22352662dd73a02a8f33a8b27824c7f9fdb2e8c40e969ad473abf0
Jul 11 01:16:09.369517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.369480    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2dd919-8714-4b98-9e55-26e28e7cca13-cert\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:09.371863 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.371830    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a2dd919-8714-4b98-9e55-26e28e7cca13-cert\") pod \"odh-model-controller-7998c67dc4-kfvn6\" (UID: \"6a2dd919-8714-4b98-9e55-26e28e7cca13\") " pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:09.450026 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.449990    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkl4l"]
Jul 11 01:16:09.453356 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.453335    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.455939 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.455912    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 11 01:16:09.465239 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.465215    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkl4l"]
Jul 11 01:16:09.519805 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.519769    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"]
Jul 11 01:16:09.521034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.521017    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:09.522011 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.521996    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.524418 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.524398    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 11 01:16:09.524418 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.524404    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2pvm4\""
Jul 11 01:16:09.524647 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.524463    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 11 01:16:09.524746 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.524717    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 11 01:16:09.524859 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.524845    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 11 01:16:09.535283 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.535262    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"]
Jul 11 01:16:09.570956 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.570919    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxzr5\" (UniqueName: \"kubernetes.io/projected/70e3472a-885d-4608-9a5a-1f0769640af2-kube-api-access-kxzr5\") pod \"model-serving-api-54d89bd5fc-rkl4l\" (UID: \"70e3472a-885d-4608-9a5a-1f0769640af2\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.571145 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.570982    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e3472a-885d-4608-9a5a-1f0769640af2-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkl4l\" (UID: \"70e3472a-885d-4608-9a5a-1f0769640af2\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.660893 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.660828    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kfvn6"]
Jul 11 01:16:09.662843 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:16:09.662814    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2dd919_8714_4b98_9e55_26e28e7cca13.slice/crio-d133d56b64e14621fb44fcd1463f9a9f7395dbfb24a2c827374d319c6a258eae WatchSource:0}: Error finding container d133d56b64e14621fb44fcd1463f9a9f7395dbfb24a2c827374d319c6a258eae: Status 404 returned error can't find the container with id d133d56b64e14621fb44fcd1463f9a9f7395dbfb24a2c827374d319c6a258eae
Jul 11 01:16:09.671548 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671517    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz76p\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-kube-api-access-xz76p\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.671654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671567    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.671654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671590    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-cacerts\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.671778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671650    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.671778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671694    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxzr5\" (UniqueName: \"kubernetes.io/projected/70e3472a-885d-4608-9a5a-1f0769640af2-kube-api-access-kxzr5\") pod \"model-serving-api-54d89bd5fc-rkl4l\" (UID: \"70e3472a-885d-4608-9a5a-1f0769640af2\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.671778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671723    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-token\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.671778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671768    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e3472a-885d-4608-9a5a-1f0769640af2-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkl4l\" (UID: \"70e3472a-885d-4608-9a5a-1f0769640af2\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.671969 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671791    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9196d4-1765-4d63-a7c7-d096761e9b4e-local-certs\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.671969 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.671820    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.674093 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.674068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e3472a-885d-4608-9a5a-1f0769640af2-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkl4l\" (UID: \"70e3472a-885d-4608-9a5a-1f0769640af2\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.679268 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.679244    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxzr5\" (UniqueName: \"kubernetes.io/projected/70e3472a-885d-4608-9a5a-1f0769640af2-kube-api-access-kxzr5\") pod \"model-serving-api-54d89bd5fc-rkl4l\" (UID: \"70e3472a-885d-4608-9a5a-1f0769640af2\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.768472 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.768433    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:09.772827 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.772797    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.772950 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.772854    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz76p\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-kube-api-access-xz76p\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.773374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.773064    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.773374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.773112    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-cacerts\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.773374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.773151    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.773374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.773237    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-token\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.773374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.773276    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9196d4-1765-4d63-a7c7-d096761e9b4e-local-certs\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.773959 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.773817    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.777709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.777683    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-cacerts\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.777816 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.777731    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.778054 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.778000    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.779531 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.779505    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9196d4-1765-4d63-a7c7-d096761e9b4e-local-certs\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.782285 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.781607    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz76p\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-kube-api-access-xz76p\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.783372 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.783351    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-token\") pod \"istiod-openshift-gateway-7574459656-hbtn9\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.831838 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.831564    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:09.863753 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.863715    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm" event={"ID":"9cdfd765-5040-4995-927f-d8600edf8a8d","Type":"ContainerStarted","Data":"dae193045c22352662dd73a02a8f33a8b27824c7f9fdb2e8c40e969ad473abf0"}
Jul 11 01:16:09.865458 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.865418    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6" event={"ID":"6a2dd919-8714-4b98-9e55-26e28e7cca13","Type":"ContainerStarted","Data":"d133d56b64e14621fb44fcd1463f9a9f7395dbfb24a2c827374d319c6a258eae"}
Jul 11 01:16:09.938140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:09.938113    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkl4l"]
Jul 11 01:16:09.941363 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:16:09.941318    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e3472a_885d_4608_9a5a_1f0769640af2.slice/crio-fe80a13e96a44417c7c266e54ab3b493123580b926fa970caf37b18836a17882 WatchSource:0}: Error finding container fe80a13e96a44417c7c266e54ab3b493123580b926fa970caf37b18836a17882: Status 404 returned error can't find the container with id fe80a13e96a44417c7c266e54ab3b493123580b926fa970caf37b18836a17882
Jul 11 01:16:10.006709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:10.006676    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"]
Jul 11 01:16:10.009679 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:16:10.009649    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9196d4_1765_4d63_a7c7_d096761e9b4e.slice/crio-952464c4e7db81714601211eb1685fbcf3e885fd1382aa46be0cf4d0605e8b8e WatchSource:0}: Error finding container 952464c4e7db81714601211eb1685fbcf3e885fd1382aa46be0cf4d0605e8b8e: Status 404 returned error can't find the container with id 952464c4e7db81714601211eb1685fbcf3e885fd1382aa46be0cf4d0605e8b8e
Jul 11 01:16:10.876524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:10.876478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" event={"ID":"8b9196d4-1765-4d63-a7c7-d096761e9b4e","Type":"ContainerStarted","Data":"952464c4e7db81714601211eb1685fbcf3e885fd1382aa46be0cf4d0605e8b8e"}
Jul 11 01:16:10.879643 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:10.879544    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l" event={"ID":"70e3472a-885d-4608-9a5a-1f0769640af2","Type":"ContainerStarted","Data":"fe80a13e96a44417c7c266e54ab3b493123580b926fa970caf37b18836a17882"}
Jul 11 01:16:14.888700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:14.888664    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 11 01:16:14.889007 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:14.888742    2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 11 01:16:15.919118 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.919080    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l" event={"ID":"70e3472a-885d-4608-9a5a-1f0769640af2","Type":"ContainerStarted","Data":"1e29cdc8359609092bc88ba072801a61688cd3189218a9c23067d9695c809d0a"}
Jul 11 01:16:15.919563 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.919190    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:15.920695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.920677    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" event={"ID":"8b9196d4-1765-4d63-a7c7-d096761e9b4e","Type":"ContainerStarted","Data":"a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752"}
Jul 11 01:16:15.920817 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.920803    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:15.922710 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.922678    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm" event={"ID":"9cdfd765-5040-4995-927f-d8600edf8a8d","Type":"ContainerStarted","Data":"960fcc1f4c04964a6506c589548f814883cd8d1434a23103931b16612af78640"}
Jul 11 01:16:15.922824 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.922728    2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-hbtn9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 11 01:16:15.922824 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.922772    2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" podUID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 11 01:16:15.924453 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.924430    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6" event={"ID":"6a2dd919-8714-4b98-9e55-26e28e7cca13","Type":"ContainerStarted","Data":"eaccf3971c261c74131b58548e6cd08ad27b629fad7eafad718c3c23d9f19e26"}
Jul 11 01:16:15.924572 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.924558    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:15.936940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.936507    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l" podStartSLOduration=1.9959941620000001 podStartE2EDuration="6.936490779s" totalImagesPullingTime="4.940496617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:15.935970502 +0000 UTC m=+598.802939054" watchObservedRunningTime="2026-07-11 01:16:15.936490779 +0000 UTC m=+598.803459330"
Jul 11 01:16:15.954503 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.954462    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57dcd4c987-56wjm" podStartSLOduration=2.052480909 podStartE2EDuration="7.954449726s" totalImagesPullingTime="5.901968817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:15.953289462 +0000 UTC m=+598.820258014" watchObservedRunningTime="2026-07-11 01:16:15.954449726 +0000 UTC m=+598.821418276"
Jul 11 01:16:15.977989 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.977942    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6" podStartSLOduration=2.742344374 podStartE2EDuration="7.977930025s" totalImagesPullingTime="5.235585651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:15.977067575 +0000 UTC m=+598.844036126" watchObservedRunningTime="2026-07-11 01:16:15.977930025 +0000 UTC m=+598.844898574"
Jul 11 01:16:15.995809 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:15.995750    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" podStartSLOduration=2.11945089 podStartE2EDuration="6.995730189s" totalImagesPullingTime="4.876279299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:15.994772525 +0000 UTC m=+598.861741078" watchObservedRunningTime="2026-07-11 01:16:15.995730189 +0000 UTC m=+598.862698741"
Jul 11 01:16:16.929584 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:16.929552    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:17.694808 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:17.694772    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:16:17.696357 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:17.696334    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:16:19.780832 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.780796    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"]
Jul 11 01:16:19.783475 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.783447    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:19.786094 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.786072    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 11 01:16:19.787246 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.787224    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-l8rp9\""
Jul 11 01:16:19.790291 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.790266    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"]
Jul 11 01:16:19.792822 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.792803    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.795925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.795907    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tmv86\""
Jul 11 01:16:19.796817 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.796797    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 11 01:16:19.797013 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.796979    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"]
Jul 11 01:16:19.808034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.808002    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"]
Jul 11 01:16:19.878500 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.873938    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a291201-6be2-4356-80fa-1991a6a7b377-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m6t6n\" (UID: \"0a291201-6be2-4356-80fa-1991a6a7b377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.878500 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.873984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5plkv\" (UniqueName: \"kubernetes.io/projected/de8cd025-87a0-4c49-bf64-23b855c0f542-kube-api-access-5plkv\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:19.878500 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.874034    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7m55\" (UniqueName: \"kubernetes.io/projected/0a291201-6be2-4356-80fa-1991a6a7b377-kube-api-access-z7m55\") pod \"llmisvc-controller-manager-777c6bd7d5-m6t6n\" (UID: \"0a291201-6be2-4356-80fa-1991a6a7b377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.878500 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.874087    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de8cd025-87a0-4c49-bf64-23b855c0f542-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:19.975182 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.975147    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a291201-6be2-4356-80fa-1991a6a7b377-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m6t6n\" (UID: \"0a291201-6be2-4356-80fa-1991a6a7b377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.975363 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.975188    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5plkv\" (UniqueName: \"kubernetes.io/projected/de8cd025-87a0-4c49-bf64-23b855c0f542-kube-api-access-5plkv\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:19.975363 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.975251    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7m55\" (UniqueName: \"kubernetes.io/projected/0a291201-6be2-4356-80fa-1991a6a7b377-kube-api-access-z7m55\") pod \"llmisvc-controller-manager-777c6bd7d5-m6t6n\" (UID: \"0a291201-6be2-4356-80fa-1991a6a7b377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.975363 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.975307    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de8cd025-87a0-4c49-bf64-23b855c0f542-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:19.975491 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:16:19.975442    2555 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 11 01:16:19.975529 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:16:19.975513    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de8cd025-87a0-4c49-bf64-23b855c0f542-cert podName:de8cd025-87a0-4c49-bf64-23b855c0f542 nodeName:}" failed. No retries permitted until 2026-07-11 01:16:20.475491811 +0000 UTC m=+603.342460342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/de8cd025-87a0-4c49-bf64-23b855c0f542-cert") pod "kserve-controller-manager-d6f4b65b8-zdlfx" (UID: "de8cd025-87a0-4c49-bf64-23b855c0f542") : secret "kserve-webhook-server-cert" not found
Jul 11 01:16:19.977746 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.977715    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a291201-6be2-4356-80fa-1991a6a7b377-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m6t6n\" (UID: \"0a291201-6be2-4356-80fa-1991a6a7b377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.988602 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.988578    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7m55\" (UniqueName: \"kubernetes.io/projected/0a291201-6be2-4356-80fa-1991a6a7b377-kube-api-access-z7m55\") pod \"llmisvc-controller-manager-777c6bd7d5-m6t6n\" (UID: \"0a291201-6be2-4356-80fa-1991a6a7b377\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:19.992902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:19.992874    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5plkv\" (UniqueName: \"kubernetes.io/projected/de8cd025-87a0-4c49-bf64-23b855c0f542-kube-api-access-5plkv\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:20.112578 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.112493    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:20.243342 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.243314    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"]
Jul 11 01:16:20.244892 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:16:20.244870    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0a291201_6be2_4356_80fa_1991a6a7b377.slice/crio-cf87f66f82f878d48b1843e17b582b1905baa78c010a3da9ece09cbdf062b02d WatchSource:0}: Error finding container cf87f66f82f878d48b1843e17b582b1905baa78c010a3da9ece09cbdf062b02d: Status 404 returned error can't find the container with id cf87f66f82f878d48b1843e17b582b1905baa78c010a3da9ece09cbdf062b02d
Jul 11 01:16:20.481267 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.481159    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de8cd025-87a0-4c49-bf64-23b855c0f542-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:20.483517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.483495    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de8cd025-87a0-4c49-bf64-23b855c0f542-cert\") pod \"kserve-controller-manager-d6f4b65b8-zdlfx\" (UID: \"de8cd025-87a0-4c49-bf64-23b855c0f542\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:20.698980 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.697990    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:20.870033 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.870006    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"]
Jul 11 01:16:20.880959 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:16:20.880930    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8cd025_87a0_4c49_bf64_23b855c0f542.slice/crio-95c616043b9b0dbc387dd4dd0dae254802d06f5296db71eb08769bf019f9cc91 WatchSource:0}: Error finding container 95c616043b9b0dbc387dd4dd0dae254802d06f5296db71eb08769bf019f9cc91: Status 404 returned error can't find the container with id 95c616043b9b0dbc387dd4dd0dae254802d06f5296db71eb08769bf019f9cc91
Jul 11 01:16:20.882285 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.882268    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:16:20.955422 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.955370    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n" event={"ID":"0a291201-6be2-4356-80fa-1991a6a7b377","Type":"ContainerStarted","Data":"cf87f66f82f878d48b1843e17b582b1905baa78c010a3da9ece09cbdf062b02d"}
Jul 11 01:16:20.956869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:20.956782    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx" event={"ID":"de8cd025-87a0-4c49-bf64-23b855c0f542","Type":"ContainerStarted","Data":"95c616043b9b0dbc387dd4dd0dae254802d06f5296db71eb08769bf019f9cc91"}
Jul 11 01:16:23.976028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:23.975923    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx" event={"ID":"de8cd025-87a0-4c49-bf64-23b855c0f542","Type":"ContainerStarted","Data":"ca60310bef0cdcc8f23b03675fe916ad7063d0ad80efc26c6afb92d15cd332a5"}
Jul 11 01:16:23.976028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:23.976000    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:16:23.977624 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:23.977597    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n" event={"ID":"0a291201-6be2-4356-80fa-1991a6a7b377","Type":"ContainerStarted","Data":"3967eb091d2f1e3c876f1a355848e15bc238e4297fde3a5521afb95e9bd5502c"}
Jul 11 01:16:23.977745 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:23.977643    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:23.994492 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:23.994451    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx" podStartSLOduration=2.151071524 podStartE2EDuration="4.99443719s" totalImagesPullingTime="2.843365666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:23.993405893 +0000 UTC m=+606.860374444" watchObservedRunningTime="2026-07-11 01:16:23.99443719 +0000 UTC m=+606.861405740"
Jul 11 01:16:24.010858 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.010812    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n" podStartSLOduration=1.533663333 podStartE2EDuration="5.010795829s" totalImagesPullingTime="3.477132496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:16:24.009683461 +0000 UTC m=+606.876652012" watchObservedRunningTime="2026-07-11 01:16:24.010795829 +0000 UTC m=+606.877764423"
Jul 11 01:16:24.466278 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.466243    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"]
Jul 11 01:16:24.466517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.466480    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" podUID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" containerName="discovery" containerID="cri-o://a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752" gracePeriod=30
Jul 11 01:16:24.718494 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.718435    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:24.822662 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822627    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-token\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.822861 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822695    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz76p\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-kube-api-access-xz76p\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.822861 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822716    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-ca-configmap\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.822861 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822843    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9196d4-1765-4d63-a7c7-d096761e9b4e-local-certs\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.823039 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822894    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-dns-cert\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.823039 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822931    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-cacerts\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.823039 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.822960    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-kubeconfig\") pod \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\" (UID: \"8b9196d4-1765-4d63-a7c7-d096761e9b4e\") "
Jul 11 01:16:24.823173 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.823043    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:16:24.824160 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.823985    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-ca-configmap\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.825609 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.825572    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:16:24.825609 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.825601    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-kube-api-access-xz76p" (OuterVolumeSpecName: "kube-api-access-xz76p") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "kube-api-access-xz76p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:16:24.828250 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.826359    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9196d4-1765-4d63-a7c7-d096761e9b4e-local-certs" (OuterVolumeSpecName: "local-certs") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:16:24.828250 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.826407    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-cacerts" (OuterVolumeSpecName: "cacerts") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:16:24.828250 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.827311    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:16:24.831829 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.831595    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "8b9196d4-1765-4d63-a7c7-d096761e9b4e" (UID: "8b9196d4-1765-4d63-a7c7-d096761e9b4e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:16:24.924902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.924859    2555 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9196d4-1765-4d63-a7c7-d096761e9b4e-local-certs\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.924902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.924897    2555 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-csr-dns-cert\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.924902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.924907    2555 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-cacerts\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.925129 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.924916    2555 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-kubeconfig\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.925129 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.924925    2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-istio-token\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.925129 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.924934    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz76p\" (UniqueName: \"kubernetes.io/projected/8b9196d4-1765-4d63-a7c7-d096761e9b4e-kube-api-access-xz76p\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:16:24.983822 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.983740    2555 generic.go:356] "Generic (PLEG): container finished" podID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" containerID="a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752" exitCode=0
Jul 11 01:16:24.983822 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.983798    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"
Jul 11 01:16:24.984295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.983817    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" event={"ID":"8b9196d4-1765-4d63-a7c7-d096761e9b4e","Type":"ContainerDied","Data":"a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752"}
Jul 11 01:16:24.984295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.983888    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9" event={"ID":"8b9196d4-1765-4d63-a7c7-d096761e9b4e","Type":"ContainerDied","Data":"952464c4e7db81714601211eb1685fbcf3e885fd1382aa46be0cf4d0605e8b8e"}
Jul 11 01:16:24.984295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.983909    2555 scope.go:117] "RemoveContainer" containerID="a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752"
Jul 11 01:16:24.992991 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.992971    2555 scope.go:117] "RemoveContainer" containerID="a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752"
Jul 11 01:16:24.993289 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:16:24.993272    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752\": container with ID starting with a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752 not found: ID does not exist" containerID="a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752"
Jul 11 01:16:24.993333 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:24.993297    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752"} err="failed to get container status \"a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752\": rpc error: code = NotFound desc = could not find container \"a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752\": container with ID starting with a38fcadff4d7199a2940a26606697ad8b0b7ddef8e6ec47a06df622456be5752 not found: ID does not exist"
Jul 11 01:16:25.004556 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:25.004536    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"]
Jul 11 01:16:25.008931 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:25.008910    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hbtn9"]
Jul 11 01:16:26.701654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:26.701617    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" path="/var/lib/kubelet/pods/8b9196d4-1765-4d63-a7c7-d096761e9b4e/volumes"
Jul 11 01:16:26.932087 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:26.932059    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kfvn6"
Jul 11 01:16:26.934479 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:26.934458    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkl4l"
Jul 11 01:16:54.986093 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:54.986016    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m6t6n"
Jul 11 01:16:54.989386 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:16:54.989364    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zdlfx"
Jul 11 01:17:09.407160 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.407128    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jzcwd"]
Jul 11 01:17:09.407552 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.407468    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" containerName="discovery"
Jul 11 01:17:09.407552 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.407478    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" containerName="discovery"
Jul 11 01:17:09.407552 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.407546    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9196d4-1765-4d63-a7c7-d096761e9b4e" containerName="discovery"
Jul 11 01:17:09.415899 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.415865    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:09.418616 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.418581    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jzcwd"]
Jul 11 01:17:09.418965 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.418943    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 11 01:17:09.420218 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.420173    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8hhxj\""
Jul 11 01:17:09.420378 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.420178    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 11 01:17:09.512257 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.512222    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nr7s\" (UniqueName: \"kubernetes.io/projected/e34c5df3-e1a2-4fff-9edc-fe193c36226d-kube-api-access-6nr7s\") pod \"kuadrant-operator-catalog-jzcwd\" (UID: \"e34c5df3-e1a2-4fff-9edc-fe193c36226d\") " pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:09.613253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.613193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nr7s\" (UniqueName: \"kubernetes.io/projected/e34c5df3-e1a2-4fff-9edc-fe193c36226d-kube-api-access-6nr7s\") pod \"kuadrant-operator-catalog-jzcwd\" (UID: \"e34c5df3-e1a2-4fff-9edc-fe193c36226d\") " pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:09.620756 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.620723    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nr7s\" (UniqueName: \"kubernetes.io/projected/e34c5df3-e1a2-4fff-9edc-fe193c36226d-kube-api-access-6nr7s\") pod \"kuadrant-operator-catalog-jzcwd\" (UID: \"e34c5df3-e1a2-4fff-9edc-fe193c36226d\") " pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:09.728085 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.727998    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:09.774661 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.774622    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jzcwd"]
Jul 11 01:17:09.890808 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.890781    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jzcwd"]
Jul 11 01:17:09.893182 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:09.893153    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34c5df3_e1a2_4fff_9edc_fe193c36226d.slice/crio-09a3ee59dfd9014d78750ba18897b3d177bd02f91009756ee93311c0057c6cd8 WatchSource:0}: Error finding container 09a3ee59dfd9014d78750ba18897b3d177bd02f91009756ee93311c0057c6cd8: Status 404 returned error can't find the container with id 09a3ee59dfd9014d78750ba18897b3d177bd02f91009756ee93311c0057c6cd8
Jul 11 01:17:09.983238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.983146    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t95dg"]
Jul 11 01:17:09.985932 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.985910    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:09.993854 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:09.993683    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t95dg"]
Jul 11 01:17:10.017130 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:10.017102    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfs5\" (UniqueName: \"kubernetes.io/projected/9fdcc432-9721-45a8-83c8-6683b0f8297e-kube-api-access-wbfs5\") pod \"kuadrant-operator-catalog-t95dg\" (UID: \"9fdcc432-9721-45a8-83c8-6683b0f8297e\") " pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:10.118322 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:10.118287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfs5\" (UniqueName: \"kubernetes.io/projected/9fdcc432-9721-45a8-83c8-6683b0f8297e-kube-api-access-wbfs5\") pod \"kuadrant-operator-catalog-t95dg\" (UID: \"9fdcc432-9721-45a8-83c8-6683b0f8297e\") " pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:10.125854 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:10.125827    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfs5\" (UniqueName: \"kubernetes.io/projected/9fdcc432-9721-45a8-83c8-6683b0f8297e-kube-api-access-wbfs5\") pod \"kuadrant-operator-catalog-t95dg\" (UID: \"9fdcc432-9721-45a8-83c8-6683b0f8297e\") " pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:10.207478 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:10.207443    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd" event={"ID":"e34c5df3-e1a2-4fff-9edc-fe193c36226d","Type":"ContainerStarted","Data":"09a3ee59dfd9014d78750ba18897b3d177bd02f91009756ee93311c0057c6cd8"}
Jul 11 01:17:10.296775 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:10.296740    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:10.431173 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:10.431139    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t95dg"]
Jul 11 01:17:10.433257 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:10.433231    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdcc432_9721_45a8_83c8_6683b0f8297e.slice/crio-097cea1d875018cc980cdbdef37ba9b4f964edbfcacc4b8978554815004b4d06 WatchSource:0}: Error finding container 097cea1d875018cc980cdbdef37ba9b4f964edbfcacc4b8978554815004b4d06: Status 404 returned error can't find the container with id 097cea1d875018cc980cdbdef37ba9b4f964edbfcacc4b8978554815004b4d06
Jul 11 01:17:11.215462 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:11.215417    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t95dg" event={"ID":"9fdcc432-9721-45a8-83c8-6683b0f8297e","Type":"ContainerStarted","Data":"097cea1d875018cc980cdbdef37ba9b4f964edbfcacc4b8978554815004b4d06"}
Jul 11 01:17:12.221936 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.221899    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd" event={"ID":"e34c5df3-e1a2-4fff-9edc-fe193c36226d","Type":"ContainerStarted","Data":"1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7"}
Jul 11 01:17:12.222431 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.221954    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd" podUID="e34c5df3-e1a2-4fff-9edc-fe193c36226d" containerName="registry-server" containerID="cri-o://1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7" gracePeriod=2
Jul 11 01:17:12.223517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.223488    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t95dg" event={"ID":"9fdcc432-9721-45a8-83c8-6683b0f8297e","Type":"ContainerStarted","Data":"22ceeeac4aa8e8aeb7727f3ec41fd0a119c69b83713d33a20a3d854ed85f71bb"}
Jul 11 01:17:12.237906 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.237864    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd" podStartSLOduration=1.1434146649999999 podStartE2EDuration="3.23784992s" totalImagesPullingTime="2.094435255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:12.2357344 +0000 UTC m=+655.102702950" watchObservedRunningTime="2026-07-11 01:17:12.23784992 +0000 UTC m=+655.104818469"
Jul 11 01:17:12.250281 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.250241    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t95dg" podStartSLOduration=1.693382353 podStartE2EDuration="3.250227591s" totalImagesPullingTime="1.556845238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:12.249753042 +0000 UTC m=+655.116721584" watchObservedRunningTime="2026-07-11 01:17:12.250227591 +0000 UTC m=+655.117196140"
Jul 11 01:17:12.466414 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.466390    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:12.537645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.537618    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nr7s\" (UniqueName: \"kubernetes.io/projected/e34c5df3-e1a2-4fff-9edc-fe193c36226d-kube-api-access-6nr7s\") pod \"e34c5df3-e1a2-4fff-9edc-fe193c36226d\" (UID: \"e34c5df3-e1a2-4fff-9edc-fe193c36226d\") "
Jul 11 01:17:12.539718 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.539696    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34c5df3-e1a2-4fff-9edc-fe193c36226d-kube-api-access-6nr7s" (OuterVolumeSpecName: "kube-api-access-6nr7s") pod "e34c5df3-e1a2-4fff-9edc-fe193c36226d" (UID: "e34c5df3-e1a2-4fff-9edc-fe193c36226d"). InnerVolumeSpecName "kube-api-access-6nr7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:17:12.638524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:12.638476    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nr7s\" (UniqueName: \"kubernetes.io/projected/e34c5df3-e1a2-4fff-9edc-fe193c36226d-kube-api-access-6nr7s\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:13.229878 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.229846    2555 generic.go:356] "Generic (PLEG): container finished" podID="e34c5df3-e1a2-4fff-9edc-fe193c36226d" containerID="1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7" exitCode=0
Jul 11 01:17:13.230303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.229892    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd"
Jul 11 01:17:13.230303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.229934    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd" event={"ID":"e34c5df3-e1a2-4fff-9edc-fe193c36226d","Type":"ContainerDied","Data":"1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7"}
Jul 11 01:17:13.230303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.229985    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jzcwd" event={"ID":"e34c5df3-e1a2-4fff-9edc-fe193c36226d","Type":"ContainerDied","Data":"09a3ee59dfd9014d78750ba18897b3d177bd02f91009756ee93311c0057c6cd8"}
Jul 11 01:17:13.230303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.230012    2555 scope.go:117] "RemoveContainer" containerID="1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7"
Jul 11 01:17:13.239637 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.239621    2555 scope.go:117] "RemoveContainer" containerID="1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7"
Jul 11 01:17:13.239885 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:17:13.239868    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7\": container with ID starting with 1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7 not found: ID does not exist" containerID="1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7"
Jul 11 01:17:13.239929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.239894    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7"} err="failed to get container status \"1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7\": rpc error: code = NotFound desc = could not find container \"1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7\": container with ID starting with 1a94245dcb659016f0237a38d4fe4b4f96f1d06b4b6a8315fa2cf1bdf443cde7 not found: ID does not exist"
Jul 11 01:17:13.247099 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.247076    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jzcwd"]
Jul 11 01:17:13.248776 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:13.248758    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jzcwd"]
Jul 11 01:17:14.701440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:14.701411    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e34c5df3-e1a2-4fff-9edc-fe193c36226d" path="/var/lib/kubelet/pods/e34c5df3-e1a2-4fff-9edc-fe193c36226d/volumes"
Jul 11 01:17:20.297640 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:20.297603    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:20.298078 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:20.297658    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:20.320903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:20.320876    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:21.291284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:21.291256    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t95dg"
Jul 11 01:17:24.958170 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.958134    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"]
Jul 11 01:17:24.958568 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.958509    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34c5df3-e1a2-4fff-9edc-fe193c36226d" containerName="registry-server"
Jul 11 01:17:24.958568 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.958520    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34c5df3-e1a2-4fff-9edc-fe193c36226d" containerName="registry-server"
Jul 11 01:17:24.958648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.958576    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34c5df3-e1a2-4fff-9edc-fe193c36226d" containerName="registry-server"
Jul 11 01:17:24.963211 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.963186    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:24.965748 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.965719    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2w9km\""
Jul 11 01:17:24.969641 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:24.969605    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"]
Jul 11 01:17:25.041022 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.040978    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.041291 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.041043    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.041291 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.041126    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8bqt\" (UniqueName: \"kubernetes.io/projected/af939131-a167-4e6c-b32d-557f2cecc631-kube-api-access-d8bqt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.142388 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.142345    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.142542 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.142398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.142542 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.142458    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8bqt\" (UniqueName: \"kubernetes.io/projected/af939131-a167-4e6c-b32d-557f2cecc631-kube-api-access-d8bqt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.142745 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.142727    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.142839 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.142818    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.149959 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.149932    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8bqt\" (UniqueName: \"kubernetes.io/projected/af939131-a167-4e6c-b32d-557f2cecc631-kube-api-access-d8bqt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.274090 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.274011    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:25.356410 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.356368    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"]
Jul 11 01:17:25.361494 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.361415    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.367305 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.367277    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"]
Jul 11 01:17:25.407637 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.407612    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"]
Jul 11 01:17:25.409604 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:25.409579    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf939131_a167_4e6c_b32d_557f2cecc631.slice/crio-ea82f0a1bec7a664d5e29300032b4ddee9286bca7882535100b2f7d1d1b85666 WatchSource:0}: Error finding container ea82f0a1bec7a664d5e29300032b4ddee9286bca7882535100b2f7d1d1b85666: Status 404 returned error can't find the container with id ea82f0a1bec7a664d5e29300032b4ddee9286bca7882535100b2f7d1d1b85666
Jul 11 01:17:25.445011 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.444984    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.445122 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.445064    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.445192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.445123    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snfrc\" (UniqueName: \"kubernetes.io/projected/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-kube-api-access-snfrc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.546555 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.546527    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snfrc\" (UniqueName: \"kubernetes.io/projected/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-kube-api-access-snfrc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.546695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.546578    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.546695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.546626    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.546944 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.546929    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.546976 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.546955    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.553901 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.553883    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snfrc\" (UniqueName: \"kubernetes.io/projected/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-kube-api-access-snfrc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.674655 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.674612    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:25.754584 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.754551    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"]
Jul 11 01:17:25.759571 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.759544    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.764519 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.764495    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"]
Jul 11 01:17:25.810527 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.810501    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"]
Jul 11 01:17:25.812277 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:25.812243    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a7e9e2_8b93_4e4a_a968_887f48f5f3f8.slice/crio-6b9705a9ca8be4fe9749c8fd3567afdee172bc707a7205d8017cdc72c64bd248 WatchSource:0}: Error finding container 6b9705a9ca8be4fe9749c8fd3567afdee172bc707a7205d8017cdc72c64bd248: Status 404 returned error can't find the container with id 6b9705a9ca8be4fe9749c8fd3567afdee172bc707a7205d8017cdc72c64bd248
Jul 11 01:17:25.848779 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.848740    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.848960 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.848857    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzm5\" (UniqueName: \"kubernetes.io/projected/023b27bc-97c8-44f4-919c-043473556c3b-kube-api-access-5hzm5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.849007 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.848971    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.950393 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.950363    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.950538 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.950410    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.950538 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.950514    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzm5\" (UniqueName: \"kubernetes.io/projected/023b27bc-97c8-44f4-919c-043473556c3b-kube-api-access-5hzm5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.950777 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.950755    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.950844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.950801    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:25.960928 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:25.960901    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzm5\" (UniqueName: \"kubernetes.io/projected/023b27bc-97c8-44f4-919c-043473556c3b-kube-api-access-5hzm5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:26.072903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.072827    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:26.162483 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.162451    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"]
Jul 11 01:17:26.167944 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.167921    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.174014 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.173983    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"]
Jul 11 01:17:26.209592 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.209571    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"]
Jul 11 01:17:26.211624 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:26.211597    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023b27bc_97c8_44f4_919c_043473556c3b.slice/crio-251e56f262bf304ed413dd15ae2784c72c538c76e8e06e395c9e7f023ec1217d WatchSource:0}: Error finding container 251e56f262bf304ed413dd15ae2784c72c538c76e8e06e395c9e7f023ec1217d: Status 404 returned error can't find the container with id 251e56f262bf304ed413dd15ae2784c72c538c76e8e06e395c9e7f023ec1217d
Jul 11 01:17:26.253496 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.253466    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrsd\" (UniqueName: \"kubernetes.io/projected/6100aeb6-4006-4d00-b100-0021cca9c32d-kube-api-access-vvrsd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.253596 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.253507    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.253596 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.253533    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.294833 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.294804    2555 generic.go:356] "Generic (PLEG): container finished" podID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerID="63499df6895ab6a2e15b30753a00a21a6c870af3e0365cceda7ba1a1f326b7da" exitCode=0
Jul 11 01:17:26.295009 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.294891    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2" event={"ID":"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8","Type":"ContainerDied","Data":"63499df6895ab6a2e15b30753a00a21a6c870af3e0365cceda7ba1a1f326b7da"}
Jul 11 01:17:26.295009 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.294948    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2" event={"ID":"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8","Type":"ContainerStarted","Data":"6b9705a9ca8be4fe9749c8fd3567afdee172bc707a7205d8017cdc72c64bd248"}
Jul 11 01:17:26.296761 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.296733    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw" event={"ID":"023b27bc-97c8-44f4-919c-043473556c3b","Type":"ContainerStarted","Data":"3d9aa47e8e7aec71d8c1c82f1b51a80cf92621ea3d2a00135b434478d4e86862"}
Jul 11 01:17:26.296890 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.296783    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw" event={"ID":"023b27bc-97c8-44f4-919c-043473556c3b","Type":"ContainerStarted","Data":"251e56f262bf304ed413dd15ae2784c72c538c76e8e06e395c9e7f023ec1217d"}
Jul 11 01:17:26.298631 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.298608    2555 generic.go:356] "Generic (PLEG): container finished" podID="af939131-a167-4e6c-b32d-557f2cecc631" containerID="0bc0c299d78181c64ad79150806d1184b177299ceb86f1e36d9bf8d7f50ebae1" exitCode=0
Jul 11 01:17:26.298755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.298694    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr" event={"ID":"af939131-a167-4e6c-b32d-557f2cecc631","Type":"ContainerDied","Data":"0bc0c299d78181c64ad79150806d1184b177299ceb86f1e36d9bf8d7f50ebae1"}
Jul 11 01:17:26.298755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.298745    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr" event={"ID":"af939131-a167-4e6c-b32d-557f2cecc631","Type":"ContainerStarted","Data":"ea82f0a1bec7a664d5e29300032b4ddee9286bca7882535100b2f7d1d1b85666"}
Jul 11 01:17:26.354462 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.354427    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrsd\" (UniqueName: \"kubernetes.io/projected/6100aeb6-4006-4d00-b100-0021cca9c32d-kube-api-access-vvrsd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.354593 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.354475    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.354681 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.354595    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.355008 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.354987    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.355050 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.354996    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.362796 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.362748    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrsd\" (UniqueName: \"kubernetes.io/projected/6100aeb6-4006-4d00-b100-0021cca9c32d-kube-api-access-vvrsd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.479787 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.479759    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:26.610435 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:26.610406    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"]
Jul 11 01:17:26.612954 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:26.612925    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6100aeb6_4006_4d00_b100_0021cca9c32d.slice/crio-29102cdde28cd1364bf2fb351ee1db3c65f5bb695bcbb75728d4b39bf8e35a7c WatchSource:0}: Error finding container 29102cdde28cd1364bf2fb351ee1db3c65f5bb695bcbb75728d4b39bf8e35a7c: Status 404 returned error can't find the container with id 29102cdde28cd1364bf2fb351ee1db3c65f5bb695bcbb75728d4b39bf8e35a7c
Jul 11 01:17:27.305417 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.305386    2555 generic.go:356] "Generic (PLEG): container finished" podID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerID="7e7bb2d98c50cb80991a0c62464d7875391b2023f351e761ae6b309a6e6deb22" exitCode=0
Jul 11 01:17:27.305864 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.305474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2" event={"ID":"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8","Type":"ContainerDied","Data":"7e7bb2d98c50cb80991a0c62464d7875391b2023f351e761ae6b309a6e6deb22"}
Jul 11 01:17:27.307064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.307042    2555 generic.go:356] "Generic (PLEG): container finished" podID="023b27bc-97c8-44f4-919c-043473556c3b" containerID="3d9aa47e8e7aec71d8c1c82f1b51a80cf92621ea3d2a00135b434478d4e86862" exitCode=0
Jul 11 01:17:27.307155 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.307111    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw" event={"ID":"023b27bc-97c8-44f4-919c-043473556c3b","Type":"ContainerDied","Data":"3d9aa47e8e7aec71d8c1c82f1b51a80cf92621ea3d2a00135b434478d4e86862"}
Jul 11 01:17:27.308777 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.308758    2555 generic.go:356] "Generic (PLEG): container finished" podID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerID="18032f1b632b341cbacadb3752e863016e776b5e43686766db5cfbfe5b664b76" exitCode=0
Jul 11 01:17:27.308876 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.308844    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg" event={"ID":"6100aeb6-4006-4d00-b100-0021cca9c32d","Type":"ContainerDied","Data":"18032f1b632b341cbacadb3752e863016e776b5e43686766db5cfbfe5b664b76"}
Jul 11 01:17:27.308950 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.308888    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg" event={"ID":"6100aeb6-4006-4d00-b100-0021cca9c32d","Type":"ContainerStarted","Data":"29102cdde28cd1364bf2fb351ee1db3c65f5bb695bcbb75728d4b39bf8e35a7c"}
Jul 11 01:17:27.310925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.310888    2555 generic.go:356] "Generic (PLEG): container finished" podID="af939131-a167-4e6c-b32d-557f2cecc631" containerID="26999be8037baa7c0bc2947c7618c8b0af1c280d24da307bfbd35b6a7b39ae20" exitCode=0
Jul 11 01:17:27.310991 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:27.310952    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr" event={"ID":"af939131-a167-4e6c-b32d-557f2cecc631","Type":"ContainerDied","Data":"26999be8037baa7c0bc2947c7618c8b0af1c280d24da307bfbd35b6a7b39ae20"}
Jul 11 01:17:28.318474 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.318447    2555 generic.go:356] "Generic (PLEG): container finished" podID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerID="a927d941fef1317dfcc0fa28c85bad6c85cd5048c5dd91bf76e2b8d0dce963f3" exitCode=0
Jul 11 01:17:28.318887 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.318520    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2" event={"ID":"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8","Type":"ContainerDied","Data":"a927d941fef1317dfcc0fa28c85bad6c85cd5048c5dd91bf76e2b8d0dce963f3"}
Jul 11 01:17:28.320286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.320264    2555 generic.go:356] "Generic (PLEG): container finished" podID="023b27bc-97c8-44f4-919c-043473556c3b" containerID="90930da80c2fa52e548bf28d619fc3a793cbe98aaffb6c087d56e192b069e8f6" exitCode=0
Jul 11 01:17:28.320390 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.320338    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw" event={"ID":"023b27bc-97c8-44f4-919c-043473556c3b","Type":"ContainerDied","Data":"90930da80c2fa52e548bf28d619fc3a793cbe98aaffb6c087d56e192b069e8f6"}
Jul 11 01:17:28.322189 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.322166    2555 generic.go:356] "Generic (PLEG): container finished" podID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerID="23ca5ceeb9621d5bb7b5ffa2ddb3c3ecd2e9d1e8da2ffaee390e425da9dfc03a" exitCode=0
Jul 11 01:17:28.322314 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.322233    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg" event={"ID":"6100aeb6-4006-4d00-b100-0021cca9c32d","Type":"ContainerDied","Data":"23ca5ceeb9621d5bb7b5ffa2ddb3c3ecd2e9d1e8da2ffaee390e425da9dfc03a"}
Jul 11 01:17:28.324628 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.324610    2555 generic.go:356] "Generic (PLEG): container finished" podID="af939131-a167-4e6c-b32d-557f2cecc631" containerID="1b674058b86e161985a6e0169847d8868584ea8955a5b9ae67a7df8f522dfe11" exitCode=0
Jul 11 01:17:28.324710 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:28.324664    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr" event={"ID":"af939131-a167-4e6c-b32d-557f2cecc631","Type":"ContainerDied","Data":"1b674058b86e161985a6e0169847d8868584ea8955a5b9ae67a7df8f522dfe11"}
Jul 11 01:17:29.331876 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.331839    2555 generic.go:356] "Generic (PLEG): container finished" podID="023b27bc-97c8-44f4-919c-043473556c3b" containerID="79b001a4a0340867ef5079292dd96e3a019be84f7630770ec530bfb09ac231fa" exitCode=0
Jul 11 01:17:29.332300 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.331929    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw" event={"ID":"023b27bc-97c8-44f4-919c-043473556c3b","Type":"ContainerDied","Data":"79b001a4a0340867ef5079292dd96e3a019be84f7630770ec530bfb09ac231fa"}
Jul 11 01:17:29.333858 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.333838    2555 generic.go:356] "Generic (PLEG): container finished" podID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerID="cc2c1f67dccb9bfee5e88730c9f694528c66e1b5e4ae8935209ade9c13723720" exitCode=0
Jul 11 01:17:29.333937 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.333917    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg" event={"ID":"6100aeb6-4006-4d00-b100-0021cca9c32d","Type":"ContainerDied","Data":"cc2c1f67dccb9bfee5e88730c9f694528c66e1b5e4ae8935209ade9c13723720"}
Jul 11 01:17:29.491436 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.491412    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:29.494778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.494757    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:29.586257 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586152    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-util\") pod \"af939131-a167-4e6c-b32d-557f2cecc631\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") "
Jul 11 01:17:29.586257 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586186    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-util\") pod \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") "
Jul 11 01:17:29.586257 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586246    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-bundle\") pod \"af939131-a167-4e6c-b32d-557f2cecc631\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") "
Jul 11 01:17:29.586523 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586319    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8bqt\" (UniqueName: \"kubernetes.io/projected/af939131-a167-4e6c-b32d-557f2cecc631-kube-api-access-d8bqt\") pod \"af939131-a167-4e6c-b32d-557f2cecc631\" (UID: \"af939131-a167-4e6c-b32d-557f2cecc631\") "
Jul 11 01:17:29.586523 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586350    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snfrc\" (UniqueName: \"kubernetes.io/projected/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-kube-api-access-snfrc\") pod \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") "
Jul 11 01:17:29.586523 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586396    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-bundle\") pod \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\" (UID: \"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8\") "
Jul 11 01:17:29.586862 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.586829    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-bundle" (OuterVolumeSpecName: "bundle") pod "af939131-a167-4e6c-b32d-557f2cecc631" (UID: "af939131-a167-4e6c-b32d-557f2cecc631"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:29.587124 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.587098    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-bundle" (OuterVolumeSpecName: "bundle") pod "f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" (UID: "f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:29.588527 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.588488    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-kube-api-access-snfrc" (OuterVolumeSpecName: "kube-api-access-snfrc") pod "f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" (UID: "f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8"). InnerVolumeSpecName "kube-api-access-snfrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:17:29.588876 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.588842    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af939131-a167-4e6c-b32d-557f2cecc631-kube-api-access-d8bqt" (OuterVolumeSpecName: "kube-api-access-d8bqt") pod "af939131-a167-4e6c-b32d-557f2cecc631" (UID: "af939131-a167-4e6c-b32d-557f2cecc631"). InnerVolumeSpecName "kube-api-access-d8bqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:17:29.592078 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.592047    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-util" (OuterVolumeSpecName: "util") pod "f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" (UID: "f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:29.593035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.593016    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-util" (OuterVolumeSpecName: "util") pod "af939131-a167-4e6c-b32d-557f2cecc631" (UID: "af939131-a167-4e6c-b32d-557f2cecc631"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:29.687271 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.687182    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8bqt\" (UniqueName: \"kubernetes.io/projected/af939131-a167-4e6c-b32d-557f2cecc631-kube-api-access-d8bqt\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:29.687271 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.687265    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snfrc\" (UniqueName: \"kubernetes.io/projected/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-kube-api-access-snfrc\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:29.687271 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.687277    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:29.687271 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.687286    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:29.687271 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.687295    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:29.687570 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:29.687302    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af939131-a167-4e6c-b32d-557f2cecc631-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:30.341367 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.341337    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2"
Jul 11 01:17:30.341785 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.341342    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2" event={"ID":"f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8","Type":"ContainerDied","Data":"6b9705a9ca8be4fe9749c8fd3567afdee172bc707a7205d8017cdc72c64bd248"}
Jul 11 01:17:30.341785 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.341465    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b9705a9ca8be4fe9749c8fd3567afdee172bc707a7205d8017cdc72c64bd248"
Jul 11 01:17:30.343374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.343338    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr" event={"ID":"af939131-a167-4e6c-b32d-557f2cecc631","Type":"ContainerDied","Data":"ea82f0a1bec7a664d5e29300032b4ddee9286bca7882535100b2f7d1d1b85666"}
Jul 11 01:17:30.343374 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.343367    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr"
Jul 11 01:17:30.343525 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.343398    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea82f0a1bec7a664d5e29300032b4ddee9286bca7882535100b2f7d1d1b85666"
Jul 11 01:17:30.500079 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.500057    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:30.502171 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.502155    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:30.594066 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.593985    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hzm5\" (UniqueName: \"kubernetes.io/projected/023b27bc-97c8-44f4-919c-043473556c3b-kube-api-access-5hzm5\") pod \"023b27bc-97c8-44f4-919c-043473556c3b\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") "
Jul 11 01:17:30.594066 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594023    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-util\") pod \"6100aeb6-4006-4d00-b100-0021cca9c32d\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") "
Jul 11 01:17:30.594318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594090    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-util\") pod \"023b27bc-97c8-44f4-919c-043473556c3b\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") "
Jul 11 01:17:30.594318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594115    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvrsd\" (UniqueName: \"kubernetes.io/projected/6100aeb6-4006-4d00-b100-0021cca9c32d-kube-api-access-vvrsd\") pod \"6100aeb6-4006-4d00-b100-0021cca9c32d\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") "
Jul 11 01:17:30.594318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594157    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-bundle\") pod \"023b27bc-97c8-44f4-919c-043473556c3b\" (UID: \"023b27bc-97c8-44f4-919c-043473556c3b\") "
Jul 11 01:17:30.594318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594223    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-bundle\") pod \"6100aeb6-4006-4d00-b100-0021cca9c32d\" (UID: \"6100aeb6-4006-4d00-b100-0021cca9c32d\") "
Jul 11 01:17:30.594794 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594720    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-bundle" (OuterVolumeSpecName: "bundle") pod "023b27bc-97c8-44f4-919c-043473556c3b" (UID: "023b27bc-97c8-44f4-919c-043473556c3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:30.594902 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.594807    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-bundle" (OuterVolumeSpecName: "bundle") pod "6100aeb6-4006-4d00-b100-0021cca9c32d" (UID: "6100aeb6-4006-4d00-b100-0021cca9c32d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:30.596367 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.596334    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6100aeb6-4006-4d00-b100-0021cca9c32d-kube-api-access-vvrsd" (OuterVolumeSpecName: "kube-api-access-vvrsd") pod "6100aeb6-4006-4d00-b100-0021cca9c32d" (UID: "6100aeb6-4006-4d00-b100-0021cca9c32d"). InnerVolumeSpecName "kube-api-access-vvrsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:17:30.596471 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.596381    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023b27bc-97c8-44f4-919c-043473556c3b-kube-api-access-5hzm5" (OuterVolumeSpecName: "kube-api-access-5hzm5") pod "023b27bc-97c8-44f4-919c-043473556c3b" (UID: "023b27bc-97c8-44f4-919c-043473556c3b"). InnerVolumeSpecName "kube-api-access-5hzm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:17:30.600055 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.600030    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-util" (OuterVolumeSpecName: "util") pod "023b27bc-97c8-44f4-919c-043473556c3b" (UID: "023b27bc-97c8-44f4-919c-043473556c3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:30.600196 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.600177    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-util" (OuterVolumeSpecName: "util") pod "6100aeb6-4006-4d00-b100-0021cca9c32d" (UID: "6100aeb6-4006-4d00-b100-0021cca9c32d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:17:30.695670 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.695632    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hzm5\" (UniqueName: \"kubernetes.io/projected/023b27bc-97c8-44f4-919c-043473556c3b-kube-api-access-5hzm5\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:30.695670 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.695667    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:30.695855 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.695681    2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-util\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:30.695855 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.695693    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvrsd\" (UniqueName: \"kubernetes.io/projected/6100aeb6-4006-4d00-b100-0021cca9c32d-kube-api-access-vvrsd\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:30.695855 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.695706    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/023b27bc-97c8-44f4-919c-043473556c3b-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:30.695855 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:30.695717    2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6100aeb6-4006-4d00-b100-0021cca9c32d-bundle\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:17:31.350600 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:31.350569    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw" event={"ID":"023b27bc-97c8-44f4-919c-043473556c3b","Type":"ContainerDied","Data":"251e56f262bf304ed413dd15ae2784c72c538c76e8e06e395c9e7f023ec1217d"}
Jul 11 01:17:31.351011 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:31.350626    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="251e56f262bf304ed413dd15ae2784c72c538c76e8e06e395c9e7f023ec1217d"
Jul 11 01:17:31.351011 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:31.350585    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw"
Jul 11 01:17:31.352612 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:31.352583    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg" event={"ID":"6100aeb6-4006-4d00-b100-0021cca9c32d","Type":"ContainerDied","Data":"29102cdde28cd1364bf2fb351ee1db3c65f5bb695bcbb75728d4b39bf8e35a7c"}
Jul 11 01:17:31.352752 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:31.352631    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg"
Jul 11 01:17:31.352752 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:31.352631    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29102cdde28cd1364bf2fb351ee1db3c65f5bb695bcbb75728d4b39bf8e35a7c"
Jul 11 01:17:42.495310 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495280    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"]
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495611    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="util"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495621    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="util"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495632    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="pull"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495638    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="pull"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495647    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="util"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495652    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="util"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495659    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="extract"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495664    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="extract"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495671    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="pull"
Jul 11 01:17:42.495675 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495676    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="pull"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495683    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="pull"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495688    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="pull"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495695    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495700    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495711    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495716    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495722    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="util"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495728    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="util"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495736    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495741    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495749    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="util"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495754    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="util"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495759    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="pull"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495764    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="pull"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495824    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495830    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="023b27bc-97c8-44f4-919c-043473556c3b" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495836    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="af939131-a167-4e6c-b32d-557f2cecc631" containerName="extract"
Jul 11 01:17:42.495971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.495841    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6100aeb6-4006-4d00-b100-0021cca9c32d" containerName="extract"
Jul 11 01:17:42.498865 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.498848    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.501625 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.501603    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6jqj\""
Jul 11 01:17:42.512294 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.512272    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"]
Jul 11 01:17:42.596752 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.596721    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg55r\" (UniqueName: \"kubernetes.io/projected/a7e29bd9-74ca-4ff3-8011-601f88b4b072-kube-api-access-vg55r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.596891 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.596791    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7e29bd9-74ca-4ff3-8011-601f88b4b072-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.697907 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.697873    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg55r\" (UniqueName: \"kubernetes.io/projected/a7e29bd9-74ca-4ff3-8011-601f88b4b072-kube-api-access-vg55r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.698062 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.697944    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7e29bd9-74ca-4ff3-8011-601f88b4b072-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.698323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.698305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7e29bd9-74ca-4ff3-8011-601f88b4b072-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.708381 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.708355    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg55r\" (UniqueName: \"kubernetes.io/projected/a7e29bd9-74ca-4ff3-8011-601f88b4b072-kube-api-access-vg55r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.809249 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.809197    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:42.944124 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:42.944096    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"]
Jul 11 01:17:42.946217 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:42.946174    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e29bd9_74ca_4ff3_8011_601f88b4b072.slice/crio-d9e5c6e9955c96da4bb4a48088bbd302dc048263f7a7baad652dff2d013aa4bb WatchSource:0}: Error finding container d9e5c6e9955c96da4bb4a48088bbd302dc048263f7a7baad652dff2d013aa4bb: Status 404 returned error can't find the container with id d9e5c6e9955c96da4bb4a48088bbd302dc048263f7a7baad652dff2d013aa4bb
Jul 11 01:17:43.414777 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:43.414740    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6" event={"ID":"a7e29bd9-74ca-4ff3-8011-601f88b4b072","Type":"ContainerStarted","Data":"d9e5c6e9955c96da4bb4a48088bbd302dc048263f7a7baad652dff2d013aa4bb"}
Jul 11 01:17:44.950001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:44.949955    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"]
Jul 11 01:17:44.953181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:44.953164    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:17:44.956148 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:44.956073    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pbw7s\""
Jul 11 01:17:44.967597 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:44.967490    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"]
Jul 11 01:17:45.121405 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:45.121373    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6szsl\" (UniqueName: \"kubernetes.io/projected/0bb2c466-185e-4307-9664-9882b04b33b3-kube-api-access-6szsl\") pod \"authorino-operator-75cc8d5cb7-pkxpd\" (UID: \"0bb2c466-185e-4307-9664-9882b04b33b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:17:45.222388 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:45.222303    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6szsl\" (UniqueName: \"kubernetes.io/projected/0bb2c466-185e-4307-9664-9882b04b33b3-kube-api-access-6szsl\") pod \"authorino-operator-75cc8d5cb7-pkxpd\" (UID: \"0bb2c466-185e-4307-9664-9882b04b33b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:17:45.230392 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:45.230358    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6szsl\" (UniqueName: \"kubernetes.io/projected/0bb2c466-185e-4307-9664-9882b04b33b3-kube-api-access-6szsl\") pod \"authorino-operator-75cc8d5cb7-pkxpd\" (UID: \"0bb2c466-185e-4307-9664-9882b04b33b3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:17:45.272154 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:45.272125    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:17:45.402616 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:45.402587    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"]
Jul 11 01:17:45.405410 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:45.405380    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb2c466_185e_4307_9664_9882b04b33b3.slice/crio-0b409f4dfc20dd166b55fe97f09a77d604361c74a7dc91278bd1c4a6a8210413 WatchSource:0}: Error finding container 0b409f4dfc20dd166b55fe97f09a77d604361c74a7dc91278bd1c4a6a8210413: Status 404 returned error can't find the container with id 0b409f4dfc20dd166b55fe97f09a77d604361c74a7dc91278bd1c4a6a8210413
Jul 11 01:17:45.425974 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:45.425945    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd" event={"ID":"0bb2c466-185e-4307-9664-9882b04b33b3","Type":"ContainerStarted","Data":"0b409f4dfc20dd166b55fe97f09a77d604361c74a7dc91278bd1c4a6a8210413"}
Jul 11 01:17:47.460865 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.460830    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"]
Jul 11 01:17:47.464817 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.464792    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:17:47.467261 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.467238    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rtqll\""
Jul 11 01:17:47.475410 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.475384    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"]
Jul 11 01:17:47.542337 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.542287    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdqk9\" (UniqueName: \"kubernetes.io/projected/4a1a3c99-634b-4212-a3b0-b8d0e63b2808-kube-api-access-rdqk9\") pod \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" (UID: \"4a1a3c99-634b-4212-a3b0-b8d0e63b2808\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:17:47.643429 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.643398    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdqk9\" (UniqueName: \"kubernetes.io/projected/4a1a3c99-634b-4212-a3b0-b8d0e63b2808-kube-api-access-rdqk9\") pod \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" (UID: \"4a1a3c99-634b-4212-a3b0-b8d0e63b2808\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:17:47.652841 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.652811    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdqk9\" (UniqueName: \"kubernetes.io/projected/4a1a3c99-634b-4212-a3b0-b8d0e63b2808-kube-api-access-rdqk9\") pod \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" (UID: \"4a1a3c99-634b-4212-a3b0-b8d0e63b2808\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:17:47.778697 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.778671    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:17:47.922133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:47.922107    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"]
Jul 11 01:17:47.923924 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:17:47.923896    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1a3c99_634b_4212_a3b0_b8d0e63b2808.slice/crio-a9f99a84b6b112e41a01d699fbcf884e251a240a3b53242862fec969bdf518cd WatchSource:0}: Error finding container a9f99a84b6b112e41a01d699fbcf884e251a240a3b53242862fec969bdf518cd: Status 404 returned error can't find the container with id a9f99a84b6b112e41a01d699fbcf884e251a240a3b53242862fec969bdf518cd
Jul 11 01:17:48.446855 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:48.446781    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs" event={"ID":"4a1a3c99-634b-4212-a3b0-b8d0e63b2808","Type":"ContainerStarted","Data":"a9f99a84b6b112e41a01d699fbcf884e251a240a3b53242862fec969bdf518cd"}
Jul 11 01:17:48.448629 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:48.448594    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd" event={"ID":"0bb2c466-185e-4307-9664-9882b04b33b3","Type":"ContainerStarted","Data":"e158ed6e9fb0981546fd1f4adc2d2d62ce008e36e375ad656a527377950d19b1"}
Jul 11 01:17:48.448766 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:48.448737    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:17:48.466751 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:48.466706    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd" podStartSLOduration=2.168214456 podStartE2EDuration="4.466687304s" totalImagesPullingTime="2.298472848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:48.464484785 +0000 UTC m=+691.331453337" watchObservedRunningTime="2026-07-11 01:17:48.466687304 +0000 UTC m=+691.333655856"
Jul 11 01:17:50.463831 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:50.463791    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6" event={"ID":"a7e29bd9-74ca-4ff3-8011-601f88b4b072","Type":"ContainerStarted","Data":"5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa"}
Jul 11 01:17:50.464325 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:50.464030    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:17:50.485020 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:50.484959    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6" podStartSLOduration=1.818485387 podStartE2EDuration="8.484944084s" totalImagesPullingTime="6.666458697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:50.481742383 +0000 UTC m=+693.348710933" watchObservedRunningTime="2026-07-11 01:17:50.484944084 +0000 UTC m=+693.351912634"
Jul 11 01:17:51.475405 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:51.475369    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs" event={"ID":"4a1a3c99-634b-4212-a3b0-b8d0e63b2808","Type":"ContainerStarted","Data":"aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0"}
Jul 11 01:17:51.475910 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:51.475433    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:17:51.498035 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:51.497983    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs" podStartSLOduration=1.851262371 podStartE2EDuration="4.497969303s" totalImagesPullingTime="2.646706932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:17:51.496239287 +0000 UTC m=+694.363207840" watchObservedRunningTime="2026-07-11 01:17:51.497969303 +0000 UTC m=+694.364937853"
Jul 11 01:17:59.456889 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:17:59.456856    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pkxpd"
Jul 11 01:18:01.477684 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:01.477653    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:02.483085 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:02.483050    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.115672 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.115636    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"]
Jul 11 01:18:03.115937 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.115824    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" containerName="manager" containerID="cri-o://5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa" gracePeriod=2
Jul 11 01:18:03.118683 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.118636    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.121467 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.121434    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"]
Jul 11 01:18:03.144561 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.144529    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"]
Jul 11 01:18:03.144940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.144924    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" containerName="manager"
Jul 11 01:18:03.144940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.144940    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" containerName="manager"
Jul 11 01:18:03.145067 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.145022    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" containerName="manager"
Jul 11 01:18:03.148091 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.148066    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"]
Jul 11 01:18:03.148232 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.148183    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.148348 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.148293    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" containerName="manager" containerID="cri-o://aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0" gracePeriod=2
Jul 11 01:18:03.149966 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.149944    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"]
Jul 11 01:18:03.150595 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.150572    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.152565 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.152535    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.154699 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.154671    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.156734 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.156705    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.165481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.165097    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"]
Jul 11 01:18:03.179491 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.179461    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"]
Jul 11 01:18:03.179654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.179503    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vg98\" (UniqueName: \"kubernetes.io/projected/0f8c11d8-4339-4173-83ca-12d06dc0defa-kube-api-access-8vg98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbspf\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.179654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.179557    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f8c11d8-4339-4173-83ca-12d06dc0defa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbspf\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.179882 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.179868    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" containerName="manager"
Jul 11 01:18:03.179953 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.179883    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" containerName="manager"
Jul 11 01:18:03.179953 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.179944    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" containerName="manager"
Jul 11 01:18:03.182943 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.182921    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:03.194168 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.194114    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.198878 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.198852    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"]
Jul 11 01:18:03.215300 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.215263    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.280316 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.280274    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vg98\" (UniqueName: \"kubernetes.io/projected/0f8c11d8-4339-4173-83ca-12d06dc0defa-kube-api-access-8vg98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbspf\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.280497 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.280338    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f8c11d8-4339-4173-83ca-12d06dc0defa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbspf\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.280497 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.280410    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgn24\" (UniqueName: \"kubernetes.io/projected/1a0943ec-27c5-484e-8f6a-884b24b0f8a2-kube-api-access-wgn24\") pod \"limitador-operator-controller-manager-859d7b78bd-w9v5j\" (UID: \"1a0943ec-27c5-484e-8f6a-884b24b0f8a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:03.280798 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.280773    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f8c11d8-4339-4173-83ca-12d06dc0defa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbspf\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.291506 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.291469    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vg98\" (UniqueName: \"kubernetes.io/projected/0f8c11d8-4339-4173-83ca-12d06dc0defa-kube-api-access-8vg98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vbspf\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.380930 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.380896    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgn24\" (UniqueName: \"kubernetes.io/projected/1a0943ec-27c5-484e-8f6a-884b24b0f8a2-kube-api-access-wgn24\") pod \"limitador-operator-controller-manager-859d7b78bd-w9v5j\" (UID: \"1a0943ec-27c5-484e-8f6a-884b24b0f8a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:03.384983 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.384960    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.387215 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.387178    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.389388 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.389361    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.397100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.397073    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgn24\" (UniqueName: \"kubernetes.io/projected/1a0943ec-27c5-484e-8f6a-884b24b0f8a2-kube-api-access-wgn24\") pod \"limitador-operator-controller-manager-859d7b78bd-w9v5j\" (UID: \"1a0943ec-27c5-484e-8f6a-884b24b0f8a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:03.401495 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.401477    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.404085 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.404062    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.406124 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.406102    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.481522 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.481493    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg55r\" (UniqueName: \"kubernetes.io/projected/a7e29bd9-74ca-4ff3-8011-601f88b4b072-kube-api-access-vg55r\") pod \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") "
Jul 11 01:18:03.481689 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.481535    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7e29bd9-74ca-4ff3-8011-601f88b4b072-extensions-socket-volume\") pod \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\" (UID: \"a7e29bd9-74ca-4ff3-8011-601f88b4b072\") "
Jul 11 01:18:03.481689 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.481615    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdqk9\" (UniqueName: \"kubernetes.io/projected/4a1a3c99-634b-4212-a3b0-b8d0e63b2808-kube-api-access-rdqk9\") pod \"4a1a3c99-634b-4212-a3b0-b8d0e63b2808\" (UID: \"4a1a3c99-634b-4212-a3b0-b8d0e63b2808\") "
Jul 11 01:18:03.482101 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.482069    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e29bd9-74ca-4ff3-8011-601f88b4b072-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7e29bd9-74ca-4ff3-8011-601f88b4b072" (UID: "a7e29bd9-74ca-4ff3-8011-601f88b4b072"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:18:03.483672 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.483653    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e29bd9-74ca-4ff3-8011-601f88b4b072-kube-api-access-vg55r" (OuterVolumeSpecName: "kube-api-access-vg55r") pod "a7e29bd9-74ca-4ff3-8011-601f88b4b072" (UID: "a7e29bd9-74ca-4ff3-8011-601f88b4b072"). InnerVolumeSpecName "kube-api-access-vg55r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:18:03.483951 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.483678    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1a3c99-634b-4212-a3b0-b8d0e63b2808-kube-api-access-rdqk9" (OuterVolumeSpecName: "kube-api-access-rdqk9") pod "4a1a3c99-634b-4212-a3b0-b8d0e63b2808" (UID: "4a1a3c99-634b-4212-a3b0-b8d0e63b2808"). InnerVolumeSpecName "kube-api-access-rdqk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:18:03.542493 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.542464    2555 generic.go:356] "Generic (PLEG): container finished" podID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" containerID="5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa" exitCode=0
Jul 11 01:18:03.542674 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.542507    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.542674 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.542569    2555 scope.go:117] "RemoveContainer" containerID="5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa"
Jul 11 01:18:03.544002 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.543978    2555 generic.go:356] "Generic (PLEG): container finished" podID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" containerID="aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0" exitCode=0
Jul 11 01:18:03.544122 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.544024    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.544856 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.544835    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.546606 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.546579    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.548703 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.548667    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.550698 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.550674    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.552571 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.552555    2555 scope.go:117] "RemoveContainer" containerID="5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa"
Jul 11 01:18:03.552872 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.552845    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa\": container with ID starting with 5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa not found: ID does not exist" containerID="5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa"
Jul 11 01:18:03.552973 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.552882    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa"} err="failed to get container status \"5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa\": rpc error: code = NotFound desc = could not find container \"5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa\": container with ID starting with 5f2e3fc7f094b0e19fa7a98240b750786d7809bab177211092e92751e6627bfa not found: ID does not exist"
Jul 11 01:18:03.552973 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.552905    2555 scope.go:117] "RemoveContainer" containerID="aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0"
Jul 11 01:18:03.553744 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.553707    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:03.556640 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.556596    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.558602 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.558580    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.560414 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.560389    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:03.561481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.561464    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:03.561553 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.561514    2555 scope.go:117] "RemoveContainer" containerID="aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0"
Jul 11 01:18:03.561811 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.561790    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0\": container with ID starting with aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0 not found: ID does not exist" containerID="aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0"
Jul 11 01:18:03.561883 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.561818    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0"} err="failed to get container status \"aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0\": rpc error: code = NotFound desc = could not find container \"aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0\": container with ID starting with aad54806e4bb4d5dcc2f1c2ebb9cc07cae83089a70117e6317f632944ef498d0 not found: ID does not exist"
Jul 11 01:18:03.562385 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:03.562365    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:03.582702 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.582677    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdqk9\" (UniqueName: \"kubernetes.io/projected/4a1a3c99-634b-4212-a3b0-b8d0e63b2808-kube-api-access-rdqk9\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:03.582702 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.582701    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg55r\" (UniqueName: \"kubernetes.io/projected/a7e29bd9-74ca-4ff3-8011-601f88b4b072-kube-api-access-vg55r\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:03.582861 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.582713    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7e29bd9-74ca-4ff3-8011-601f88b4b072-extensions-socket-volume\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:03.746481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.746454    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"]
Jul 11 01:18:03.748370 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:18:03.748339    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8c11d8_4339_4173_83ca_12d06dc0defa.slice/crio-cd3b1827f3054e9830db272a32566ab2bf055c454a8628b4c9d156383fb603c5 WatchSource:0}: Error finding container cd3b1827f3054e9830db272a32566ab2bf055c454a8628b4c9d156383fb603c5: Status 404 returned error can't find the container with id cd3b1827f3054e9830db272a32566ab2bf055c454a8628b4c9d156383fb603c5
Jul 11 01:18:03.763948 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:03.763887    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"]
Jul 11 01:18:03.769101 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:18:03.769073    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0943ec_27c5_484e_8f6a_884b24b0f8a2.slice/crio-ee417cd7818b5b798cf1ca4778fb0ff420ee3ebfd044b6dd44ff505a2fff09ae WatchSource:0}: Error finding container ee417cd7818b5b798cf1ca4778fb0ff420ee3ebfd044b6dd44ff505a2fff09ae: Status 404 returned error can't find the container with id ee417cd7818b5b798cf1ca4778fb0ff420ee3ebfd044b6dd44ff505a2fff09ae
Jul 11 01:18:04.210232 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.210181    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"]
Jul 11 01:18:04.213966 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.213943    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.225837 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.225811    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"]
Jul 11 01:18:04.238259 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:04.238223    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:04.240319 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:04.240295    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:04.288034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.288000    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb9fz\" (UniqueName: \"kubernetes.io/projected/b59870fe-7b91-458f-84ce-54cb7373fa80-kube-api-access-vb9fz\") pod \"kuadrant-operator-controller-manager-86878c769f-zhptq\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.288224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.288045    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b59870fe-7b91-458f-84ce-54cb7373fa80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zhptq\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.389504 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.389459    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb9fz\" (UniqueName: \"kubernetes.io/projected/b59870fe-7b91-458f-84ce-54cb7373fa80-kube-api-access-vb9fz\") pod \"kuadrant-operator-controller-manager-86878c769f-zhptq\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.389504 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.389506    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b59870fe-7b91-458f-84ce-54cb7373fa80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zhptq\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.389954 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.389937    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b59870fe-7b91-458f-84ce-54cb7373fa80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zhptq\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.403505 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.403443    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb9fz\" (UniqueName: \"kubernetes.io/projected/b59870fe-7b91-458f-84ce-54cb7373fa80-kube-api-access-vb9fz\") pod \"kuadrant-operator-controller-manager-86878c769f-zhptq\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.523800 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.523763    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:04.556518 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.556473    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j" event={"ID":"1a0943ec-27c5-484e-8f6a-884b24b0f8a2","Type":"ContainerStarted","Data":"77deb5108884216d0404d4d8a89db2b9ff3dbaa477331bff27a002d4e303a55a"}
Jul 11 01:18:04.556688 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.556559    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j" event={"ID":"1a0943ec-27c5-484e-8f6a-884b24b0f8a2","Type":"ContainerStarted","Data":"ee417cd7818b5b798cf1ca4778fb0ff420ee3ebfd044b6dd44ff505a2fff09ae"}
Jul 11 01:18:04.560224 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.556781    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:04.560224 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:04.558976    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:04.565684 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.565558    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf" event={"ID":"0f8c11d8-4339-4173-83ca-12d06dc0defa","Type":"ContainerStarted","Data":"fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2"}
Jul 11 01:18:04.565684 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.565599    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf" event={"ID":"0f8c11d8-4339-4173-83ca-12d06dc0defa","Type":"ContainerStarted","Data":"cd3b1827f3054e9830db272a32566ab2bf055c454a8628b4c9d156383fb603c5"}
Jul 11 01:18:04.565684 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.565638    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:04.575163 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.575118    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j" podStartSLOduration=1.575106006 podStartE2EDuration="1.575106006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:04.573990404 +0000 UTC m=+707.440958954" watchObservedRunningTime="2026-07-11 01:18:04.575106006 +0000 UTC m=+707.442074557"
Jul 11 01:18:04.575933 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:04.575904    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:04.577787 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:04.577763    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q2vg6\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q2vg6"
Jul 11 01:18:04.579712 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:04.579683    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zsqjs\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zsqjs"
Jul 11 01:18:04.597562 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.597511    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf" podStartSLOduration=1.597489866 podStartE2EDuration="1.597489866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:04.595604173 +0000 UTC m=+707.462572724" watchObservedRunningTime="2026-07-11 01:18:04.597489866 +0000 UTC m=+707.464458416"
Jul 11 01:18:04.668051 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.668026    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"]
Jul 11 01:18:04.669741 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:18:04.669707    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59870fe_7b91_458f_84ce_54cb7373fa80.slice/crio-c30eee006b64dc7133a6d56f8f9d0ce39140907ed02bf76f769e95b24907da9c WatchSource:0}: Error finding container c30eee006b64dc7133a6d56f8f9d0ce39140907ed02bf76f769e95b24907da9c: Status 404 returned error can't find the container with id c30eee006b64dc7133a6d56f8f9d0ce39140907ed02bf76f769e95b24907da9c
Jul 11 01:18:04.700996 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.700970    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a1a3c99-634b-4212-a3b0-b8d0e63b2808" path="/var/lib/kubelet/pods/4a1a3c99-634b-4212-a3b0-b8d0e63b2808/volumes"
Jul 11 01:18:04.701373 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:04.701357    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e29bd9-74ca-4ff3-8011-601f88b4b072" path="/var/lib/kubelet/pods/a7e29bd9-74ca-4ff3-8011-601f88b4b072/volumes"
Jul 11 01:18:05.573666 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:05.573621    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq" event={"ID":"b59870fe-7b91-458f-84ce-54cb7373fa80","Type":"ContainerStarted","Data":"0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce"}
Jul 11 01:18:05.574050 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:05.573693    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:05.574050 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:05.573718    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq" event={"ID":"b59870fe-7b91-458f-84ce-54cb7373fa80","Type":"ContainerStarted","Data":"c30eee006b64dc7133a6d56f8f9d0ce39140907ed02bf76f769e95b24907da9c"}
Jul 11 01:18:05.594772 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:05.594722    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq" podStartSLOduration=1.594708609 podStartE2EDuration="1.594708609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:05.591544196 +0000 UTC m=+708.458512745" watchObservedRunningTime="2026-07-11 01:18:05.594708609 +0000 UTC m=+708.461677158"
Jul 11 01:18:15.575764 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:15.575685    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:15.575764 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:15.575758    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w9v5j"
Jul 11 01:18:16.581704 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:16.581673    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:18:16.627826 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:16.627790    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"]
Jul 11 01:18:16.628182 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:16.628148    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf" podUID="0f8c11d8-4339-4173-83ca-12d06dc0defa" containerName="manager" containerID="cri-o://fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2" gracePeriod=10
Jul 11 01:18:16.889339 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:16.889311    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:17.004193 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.004160    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f8c11d8-4339-4173-83ca-12d06dc0defa-extensions-socket-volume\") pod \"0f8c11d8-4339-4173-83ca-12d06dc0defa\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") "
Jul 11 01:18:17.004379 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.004197    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vg98\" (UniqueName: \"kubernetes.io/projected/0f8c11d8-4339-4173-83ca-12d06dc0defa-kube-api-access-8vg98\") pod \"0f8c11d8-4339-4173-83ca-12d06dc0defa\" (UID: \"0f8c11d8-4339-4173-83ca-12d06dc0defa\") "
Jul 11 01:18:17.004524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.004501    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f8c11d8-4339-4173-83ca-12d06dc0defa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f8c11d8-4339-4173-83ca-12d06dc0defa" (UID: "0f8c11d8-4339-4173-83ca-12d06dc0defa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:18:17.006284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.006261    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f8c11d8-4339-4173-83ca-12d06dc0defa-kube-api-access-8vg98" (OuterVolumeSpecName: "kube-api-access-8vg98") pod "0f8c11d8-4339-4173-83ca-12d06dc0defa" (UID: "0f8c11d8-4339-4173-83ca-12d06dc0defa"). InnerVolumeSpecName "kube-api-access-8vg98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:18:17.104949 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.104863    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f8c11d8-4339-4173-83ca-12d06dc0defa-extensions-socket-volume\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:17.104949 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.104890    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vg98\" (UniqueName: \"kubernetes.io/projected/0f8c11d8-4339-4173-83ca-12d06dc0defa-kube-api-access-8vg98\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:17.643469 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.643434    2555 generic.go:356] "Generic (PLEG): container finished" podID="0f8c11d8-4339-4173-83ca-12d06dc0defa" containerID="fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2" exitCode=0
Jul 11 01:18:17.643910 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.643492    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"
Jul 11 01:18:17.643910 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.643516    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf" event={"ID":"0f8c11d8-4339-4173-83ca-12d06dc0defa","Type":"ContainerDied","Data":"fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2"}
Jul 11 01:18:17.643910 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.643589    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf" event={"ID":"0f8c11d8-4339-4173-83ca-12d06dc0defa","Type":"ContainerDied","Data":"cd3b1827f3054e9830db272a32566ab2bf055c454a8628b4c9d156383fb603c5"}
Jul 11 01:18:17.643910 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.643614    2555 scope.go:117] "RemoveContainer" containerID="fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2"
Jul 11 01:18:17.652740 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.652724    2555 scope.go:117] "RemoveContainer" containerID="fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2"
Jul 11 01:18:17.653003 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:17.652983    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2\": container with ID starting with fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2 not found: ID does not exist" containerID="fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2"
Jul 11 01:18:17.653073 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.653011    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2"} err="failed to get container status \"fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2\": rpc error: code = NotFound desc = could not find container \"fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2\": container with ID starting with fab92778e88c9d5f4d29876c9b81ddd164012c882df1123f5a9d7c3bc67832a2 not found: ID does not exist"
Jul 11 01:18:17.665110 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.665085    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"]
Jul 11 01:18:17.670742 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:17.670718    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vbspf"]
Jul 11 01:18:18.699021 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:18.698989    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f8c11d8-4339-4173-83ca-12d06dc0defa" path="/var/lib/kubelet/pods/0f8c11d8-4339-4173-83ca-12d06dc0defa/volumes"
Jul 11 01:18:34.924225 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.924170    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:34.924794 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.924555    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f8c11d8-4339-4173-83ca-12d06dc0defa" containerName="manager"
Jul 11 01:18:34.924794 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.924571    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f8c11d8-4339-4173-83ca-12d06dc0defa" containerName="manager"
Jul 11 01:18:34.924794 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.924648    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f8c11d8-4339-4173-83ca-12d06dc0defa" containerName="manager"
Jul 11 01:18:34.929436 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.929415    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:34.931915 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.931895    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 11 01:18:34.931991 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.931908    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2w9km\""
Jul 11 01:18:34.938303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:34.938279    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:35.031663 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.031633    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:35.064549 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.064515    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f9b626-a49d-4bca-97eb-0e9b9f3087db-config-file\") pod \"limitador-limitador-64c94fd64f-jhdbk\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.064549 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.064549    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97f6\" (UniqueName: \"kubernetes.io/projected/59f9b626-a49d-4bca-97eb-0e9b9f3087db-kube-api-access-j97f6\") pod \"limitador-limitador-64c94fd64f-jhdbk\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.165327 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.165287    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f9b626-a49d-4bca-97eb-0e9b9f3087db-config-file\") pod \"limitador-limitador-64c94fd64f-jhdbk\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.165327 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.165324    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97f6\" (UniqueName: \"kubernetes.io/projected/59f9b626-a49d-4bca-97eb-0e9b9f3087db-kube-api-access-j97f6\") pod \"limitador-limitador-64c94fd64f-jhdbk\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.165964 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.165942    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f9b626-a49d-4bca-97eb-0e9b9f3087db-config-file\") pod \"limitador-limitador-64c94fd64f-jhdbk\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.176175 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.176109    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97f6\" (UniqueName: \"kubernetes.io/projected/59f9b626-a49d-4bca-97eb-0e9b9f3087db-kube-api-access-j97f6\") pod \"limitador-limitador-64c94fd64f-jhdbk\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.242680 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.242631    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:35.380191 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.380167    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:35.382456 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:18:35.382424    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f9b626_a49d_4bca_97eb_0e9b9f3087db.slice/crio-46d83020ce7de3aa5b00159f22d96ba9a967e8f9d291c6067cf1c7d539681b50 WatchSource:0}: Error finding container 46d83020ce7de3aa5b00159f22d96ba9a967e8f9d291c6067cf1c7d539681b50: Status 404 returned error can't find the container with id 46d83020ce7de3aa5b00159f22d96ba9a967e8f9d291c6067cf1c7d539681b50
Jul 11 01:18:35.727192 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.727157    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-84pjg"]
Jul 11 01:18:35.730733 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.730711    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:35.733041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.733025    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmtrn\""
Jul 11 01:18:35.737349 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.737327    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-84pjg"]
Jul 11 01:18:35.742539 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.742511    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk" event={"ID":"59f9b626-a49d-4bca-97eb-0e9b9f3087db","Type":"ContainerStarted","Data":"46d83020ce7de3aa5b00159f22d96ba9a967e8f9d291c6067cf1c7d539681b50"}
Jul 11 01:18:35.871602 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.871571    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd6nr\" (UniqueName: \"kubernetes.io/projected/bf818935-0515-487d-98d2-7a44e6c2e2ac-kube-api-access-jd6nr\") pod \"authorino-58cd955675-84pjg\" (UID: \"bf818935-0515-487d-98d2-7a44e6c2e2ac\") " pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:35.972659 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.972618    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd6nr\" (UniqueName: \"kubernetes.io/projected/bf818935-0515-487d-98d2-7a44e6c2e2ac-kube-api-access-jd6nr\") pod \"authorino-58cd955675-84pjg\" (UID: \"bf818935-0515-487d-98d2-7a44e6c2e2ac\") " pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:35.980152 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:35.980097    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd6nr\" (UniqueName: \"kubernetes.io/projected/bf818935-0515-487d-98d2-7a44e6c2e2ac-kube-api-access-jd6nr\") pod \"authorino-58cd955675-84pjg\" (UID: \"bf818935-0515-487d-98d2-7a44e6c2e2ac\") " pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:36.042656 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:36.042624    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:36.213510 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:36.213448    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-84pjg"]
Jul 11 01:18:36.215705 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:18:36.215676    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf818935_0515_487d_98d2_7a44e6c2e2ac.slice/crio-62001fb6acb5d009774b6a95bc175269d0df046f12ab92cf0de31539e9571fb2 WatchSource:0}: Error finding container 62001fb6acb5d009774b6a95bc175269d0df046f12ab92cf0de31539e9571fb2: Status 404 returned error can't find the container with id 62001fb6acb5d009774b6a95bc175269d0df046f12ab92cf0de31539e9571fb2
Jul 11 01:18:36.750351 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:36.750321    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-84pjg" event={"ID":"bf818935-0515-487d-98d2-7a44e6c2e2ac","Type":"ContainerStarted","Data":"62001fb6acb5d009774b6a95bc175269d0df046f12ab92cf0de31539e9571fb2"}
Jul 11 01:18:40.777810 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:40.777759    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk" event={"ID":"59f9b626-a49d-4bca-97eb-0e9b9f3087db","Type":"ContainerStarted","Data":"fc8df4f024607e336c141172e8b2871b18e331668a8cb218a6fe27ee94c792d2"}
Jul 11 01:18:40.778342 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:40.777840    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:40.779273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:40.779251    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-84pjg" event={"ID":"bf818935-0515-487d-98d2-7a44e6c2e2ac","Type":"ContainerStarted","Data":"3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668"}
Jul 11 01:18:40.794478 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:40.794425    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk" podStartSLOduration=2.289711457 podStartE2EDuration="6.794412267s" totalImagesPullingTime="4.50470081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:40.793562103 +0000 UTC m=+743.660530651" watchObservedRunningTime="2026-07-11 01:18:40.794412267 +0000 UTC m=+743.661380815"
Jul 11 01:18:40.806260 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:40.806219    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-84pjg" podStartSLOduration=2.08504719 podStartE2EDuration="5.80618938s" totalImagesPullingTime="3.72114219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:18:40.805873653 +0000 UTC m=+743.672842202" watchObservedRunningTime="2026-07-11 01:18:40.80618938 +0000 UTC m=+743.673157927"
Jul 11 01:18:41.088574 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:41.088534    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-84pjg"]
Jul 11 01:18:42.789279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:42.789245    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-84pjg" podUID="bf818935-0515-487d-98d2-7a44e6c2e2ac" containerName="authorino" containerID="cri-o://3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668" gracePeriod=30
Jul 11 01:18:43.042848 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.042785    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:43.133362 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.133324    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd6nr\" (UniqueName: \"kubernetes.io/projected/bf818935-0515-487d-98d2-7a44e6c2e2ac-kube-api-access-jd6nr\") pod \"bf818935-0515-487d-98d2-7a44e6c2e2ac\" (UID: \"bf818935-0515-487d-98d2-7a44e6c2e2ac\") "
Jul 11 01:18:43.135364 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.135335    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf818935-0515-487d-98d2-7a44e6c2e2ac-kube-api-access-jd6nr" (OuterVolumeSpecName: "kube-api-access-jd6nr") pod "bf818935-0515-487d-98d2-7a44e6c2e2ac" (UID: "bf818935-0515-487d-98d2-7a44e6c2e2ac"). InnerVolumeSpecName "kube-api-access-jd6nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:18:43.234628 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.234584    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd6nr\" (UniqueName: \"kubernetes.io/projected/bf818935-0515-487d-98d2-7a44e6c2e2ac-kube-api-access-jd6nr\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:43.795930 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.795895    2555 generic.go:356] "Generic (PLEG): container finished" podID="bf818935-0515-487d-98d2-7a44e6c2e2ac" containerID="3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668" exitCode=0
Jul 11 01:18:43.796382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.795939    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-84pjg"
Jul 11 01:18:43.796382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.795978    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-84pjg" event={"ID":"bf818935-0515-487d-98d2-7a44e6c2e2ac","Type":"ContainerDied","Data":"3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668"}
Jul 11 01:18:43.796382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.796022    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-84pjg" event={"ID":"bf818935-0515-487d-98d2-7a44e6c2e2ac","Type":"ContainerDied","Data":"62001fb6acb5d009774b6a95bc175269d0df046f12ab92cf0de31539e9571fb2"}
Jul 11 01:18:43.796382 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.796041    2555 scope.go:117] "RemoveContainer" containerID="3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668"
Jul 11 01:18:43.805543 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.805526    2555 scope.go:117] "RemoveContainer" containerID="3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668"
Jul 11 01:18:43.805774 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:18:43.805757    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668\": container with ID starting with 3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668 not found: ID does not exist" containerID="3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668"
Jul 11 01:18:43.805837 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.805784    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668"} err="failed to get container status \"3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668\": rpc error: code = NotFound desc = could not find container \"3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668\": container with ID starting with 3abf0e1e9542a6e0baa984c202b545238b8691f07654cc6852617098cdf65668 not found: ID does not exist"
Jul 11 01:18:43.816850 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.816826    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-84pjg"]
Jul 11 01:18:43.818834 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:43.818816    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-84pjg"]
Jul 11 01:18:44.699152 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:44.699119    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf818935-0515-487d-98d2-7a44e6c2e2ac" path="/var/lib/kubelet/pods/bf818935-0515-487d-98d2-7a44e6c2e2ac/volumes"
Jul 11 01:18:51.785297 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:51.785260    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:52.079673 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:52.079586    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:52.079844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:52.079762    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk" podUID="59f9b626-a49d-4bca-97eb-0e9b9f3087db" containerName="limitador" containerID="cri-o://fc8df4f024607e336c141172e8b2871b18e331668a8cb218a6fe27ee94c792d2" gracePeriod=30
Jul 11 01:18:52.845868 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:52.845836    2555 generic.go:356] "Generic (PLEG): container finished" podID="59f9b626-a49d-4bca-97eb-0e9b9f3087db" containerID="fc8df4f024607e336c141172e8b2871b18e331668a8cb218a6fe27ee94c792d2" exitCode=0
Jul 11 01:18:52.846249 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:52.845909    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk" event={"ID":"59f9b626-a49d-4bca-97eb-0e9b9f3087db","Type":"ContainerDied","Data":"fc8df4f024607e336c141172e8b2871b18e331668a8cb218a6fe27ee94c792d2"}
Jul 11 01:18:53.028478 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.028456    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:53.119928 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.119836    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f9b626-a49d-4bca-97eb-0e9b9f3087db-config-file\") pod \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") "
Jul 11 01:18:53.120076 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.119945    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j97f6\" (UniqueName: \"kubernetes.io/projected/59f9b626-a49d-4bca-97eb-0e9b9f3087db-kube-api-access-j97f6\") pod \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\" (UID: \"59f9b626-a49d-4bca-97eb-0e9b9f3087db\") "
Jul 11 01:18:53.120253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.120231    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f9b626-a49d-4bca-97eb-0e9b9f3087db-config-file" (OuterVolumeSpecName: "config-file") pod "59f9b626-a49d-4bca-97eb-0e9b9f3087db" (UID: "59f9b626-a49d-4bca-97eb-0e9b9f3087db"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:18:53.121866 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.121846    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f9b626-a49d-4bca-97eb-0e9b9f3087db-kube-api-access-j97f6" (OuterVolumeSpecName: "kube-api-access-j97f6") pod "59f9b626-a49d-4bca-97eb-0e9b9f3087db" (UID: "59f9b626-a49d-4bca-97eb-0e9b9f3087db"). InnerVolumeSpecName "kube-api-access-j97f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:18:53.220614 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.220585    2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59f9b626-a49d-4bca-97eb-0e9b9f3087db-config-file\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:53.220614 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.220611    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j97f6\" (UniqueName: \"kubernetes.io/projected/59f9b626-a49d-4bca-97eb-0e9b9f3087db-kube-api-access-j97f6\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:18:53.853929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.853897    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk" event={"ID":"59f9b626-a49d-4bca-97eb-0e9b9f3087db","Type":"ContainerDied","Data":"46d83020ce7de3aa5b00159f22d96ba9a967e8f9d291c6067cf1c7d539681b50"}
Jul 11 01:18:53.853929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.853915    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"
Jul 11 01:18:53.854437 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.853965    2555 scope.go:117] "RemoveContainer" containerID="fc8df4f024607e336c141172e8b2871b18e331668a8cb218a6fe27ee94c792d2"
Jul 11 01:18:53.879036 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.879011    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:53.883911 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:53.883889    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jhdbk"]
Jul 11 01:18:54.699214 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:54.699172    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f9b626-a49d-4bca-97eb-0e9b9f3087db" path="/var/lib/kubelet/pods/59f9b626-a49d-4bca-97eb-0e9b9f3087db/volumes"
Jul 11 01:18:56.534393 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534361    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"]
Jul 11 01:18:56.534852 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534836    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f9b626-a49d-4bca-97eb-0e9b9f3087db" containerName="limitador"
Jul 11 01:18:56.534903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534855    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f9b626-a49d-4bca-97eb-0e9b9f3087db" containerName="limitador"
Jul 11 01:18:56.534903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534879    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf818935-0515-487d-98d2-7a44e6c2e2ac" containerName="authorino"
Jul 11 01:18:56.534903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534885    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf818935-0515-487d-98d2-7a44e6c2e2ac" containerName="authorino"
Jul 11 01:18:56.535004 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534940    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f9b626-a49d-4bca-97eb-0e9b9f3087db" containerName="limitador"
Jul 11 01:18:56.535004 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.534948    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf818935-0515-487d-98d2-7a44e6c2e2ac" containerName="authorino"
Jul 11 01:18:56.539370 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.539353    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.542040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.542021    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 11 01:18:56.543237 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.543191    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 11 01:18:56.543854 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.543432    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 11 01:18:56.543963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.543495    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cs6sx\""
Jul 11 01:18:56.546579 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.546553    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"]
Jul 11 01:18:56.644900 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.644859    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/655a1557-fad4-4467-bfa6-1b0ba4ce2350-data\") pod \"postgres-69fb4594cf-s8kww\" (UID: \"655a1557-fad4-4467-bfa6-1b0ba4ce2350\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.645077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.644981    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gb46\" (UniqueName: \"kubernetes.io/projected/655a1557-fad4-4467-bfa6-1b0ba4ce2350-kube-api-access-2gb46\") pod \"postgres-69fb4594cf-s8kww\" (UID: \"655a1557-fad4-4467-bfa6-1b0ba4ce2350\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.746007 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.745977    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gb46\" (UniqueName: \"kubernetes.io/projected/655a1557-fad4-4467-bfa6-1b0ba4ce2350-kube-api-access-2gb46\") pod \"postgres-69fb4594cf-s8kww\" (UID: \"655a1557-fad4-4467-bfa6-1b0ba4ce2350\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.746170 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.746021    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/655a1557-fad4-4467-bfa6-1b0ba4ce2350-data\") pod \"postgres-69fb4594cf-s8kww\" (UID: \"655a1557-fad4-4467-bfa6-1b0ba4ce2350\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.746400 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.746384    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/655a1557-fad4-4467-bfa6-1b0ba4ce2350-data\") pod \"postgres-69fb4594cf-s8kww\" (UID: \"655a1557-fad4-4467-bfa6-1b0ba4ce2350\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.754023 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.753991    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gb46\" (UniqueName: \"kubernetes.io/projected/655a1557-fad4-4467-bfa6-1b0ba4ce2350-kube-api-access-2gb46\") pod \"postgres-69fb4594cf-s8kww\" (UID: \"655a1557-fad4-4467-bfa6-1b0ba4ce2350\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.850865 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.850779    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:18:56.990014 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:56.989986    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"]
Jul 11 01:18:56.992117 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:18:56.992092    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655a1557_fad4_4467_bfa6_1b0ba4ce2350.slice/crio-cd9d30ed48fcc7bbd51897158e81d5ea8e2b6a4fcbe858c678a0719f4b02049a WatchSource:0}: Error finding container cd9d30ed48fcc7bbd51897158e81d5ea8e2b6a4fcbe858c678a0719f4b02049a: Status 404 returned error can't find the container with id cd9d30ed48fcc7bbd51897158e81d5ea8e2b6a4fcbe858c678a0719f4b02049a
Jul 11 01:18:57.882559 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:18:57.882475    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww" event={"ID":"655a1557-fad4-4467-bfa6-1b0ba4ce2350","Type":"ContainerStarted","Data":"cd9d30ed48fcc7bbd51897158e81d5ea8e2b6a4fcbe858c678a0719f4b02049a"}
Jul 11 01:19:01.908867 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:01.908832    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww" event={"ID":"655a1557-fad4-4467-bfa6-1b0ba4ce2350","Type":"ContainerStarted","Data":"7bda7ca26ddb0478ce1ce89bdfd19582d9431c7bed545a51dd303c1e7861b638"}
Jul 11 01:19:01.909249 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:01.908984    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:19:01.925726 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:01.925681    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww" podStartSLOduration=1.152055294 podStartE2EDuration="5.925667619s" totalImagesPullingTime="4.773612325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:01.923104024 +0000 UTC m=+764.790072576" watchObservedRunningTime="2026-07-11 01:19:01.925667619 +0000 UTC m=+764.792636166"
Jul 11 01:19:07.943794 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:07.943761    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s8kww"
Jul 11 01:19:08.467446 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.467414    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7xv9r"]
Jul 11 01:19:08.474420 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.474392    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:08.475567 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.475536    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7xv9r"]
Jul 11 01:19:08.476828 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.476803    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmtrn\""
Jul 11 01:19:08.552895 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.552857    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lptxb\" (UniqueName: \"kubernetes.io/projected/ab4c8f08-85ac-4172-9a85-91824d03c75e-kube-api-access-lptxb\") pod \"authorino-5d4b67c446-7xv9r\" (UID: \"ab4c8f08-85ac-4172-9a85-91824d03c75e\") " pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:08.653887 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.653858    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lptxb\" (UniqueName: \"kubernetes.io/projected/ab4c8f08-85ac-4172-9a85-91824d03c75e-kube-api-access-lptxb\") pod \"authorino-5d4b67c446-7xv9r\" (UID: \"ab4c8f08-85ac-4172-9a85-91824d03c75e\") " pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:08.661557 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.661527    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lptxb\" (UniqueName: \"kubernetes.io/projected/ab4c8f08-85ac-4172-9a85-91824d03c75e-kube-api-access-lptxb\") pod \"authorino-5d4b67c446-7xv9r\" (UID: \"ab4c8f08-85ac-4172-9a85-91824d03c75e\") " pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:08.699591 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.699559    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7xv9r"]
Jul 11 01:19:08.699806 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.699794    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:08.723575 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.723505    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fc774d65f-fkgsj"]
Jul 11 01:19:08.729352 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.729324    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:08.732136 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.732109    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc774d65f-fkgsj"]
Jul 11 01:19:08.838310 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.838288    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7xv9r"]
Jul 11 01:19:08.840433 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:19:08.840402    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab4c8f08_85ac_4172_9a85_91824d03c75e.slice/crio-b404d015aa71eb51bd68b4631baf71e0d98ebb0f85892034a5e4cbe15f195ddc WatchSource:0}: Error finding container b404d015aa71eb51bd68b4631baf71e0d98ebb0f85892034a5e4cbe15f195ddc: Status 404 returned error can't find the container with id b404d015aa71eb51bd68b4631baf71e0d98ebb0f85892034a5e4cbe15f195ddc
Jul 11 01:19:08.856466 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.856438    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2tl2\" (UniqueName: \"kubernetes.io/projected/d8e86d59-3ffe-42ef-9fed-e180416a9d50-kube-api-access-h2tl2\") pod \"authorino-7fc774d65f-fkgsj\" (UID: \"d8e86d59-3ffe-42ef-9fed-e180416a9d50\") " pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:08.937110 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.937077    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fc774d65f-fkgsj"]
Jul 11 01:19:08.937357 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:08.937337    2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h2tl2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7fc774d65f-fkgsj" podUID="d8e86d59-3ffe-42ef-9fed-e180416a9d50"
Jul 11 01:19:08.948932 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.948901    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:08.948932 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.948914    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7xv9r" event={"ID":"ab4c8f08-85ac-4172-9a85-91824d03c75e","Type":"ContainerStarted","Data":"b404d015aa71eb51bd68b4631baf71e0d98ebb0f85892034a5e4cbe15f195ddc"}
Jul 11 01:19:08.957056 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.957036    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:08.957483 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.957464    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2tl2\" (UniqueName: \"kubernetes.io/projected/d8e86d59-3ffe-42ef-9fed-e180416a9d50-kube-api-access-h2tl2\") pod \"authorino-7fc774d65f-fkgsj\" (UID: \"d8e86d59-3ffe-42ef-9fed-e180416a9d50\") " pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:08.969478 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:08.969457    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2tl2\" (UniqueName: \"kubernetes.io/projected/d8e86d59-3ffe-42ef-9fed-e180416a9d50-kube-api-access-h2tl2\") pod \"authorino-7fc774d65f-fkgsj\" (UID: \"d8e86d59-3ffe-42ef-9fed-e180416a9d50\") " pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:09.058323 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.058292    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2tl2\" (UniqueName: \"kubernetes.io/projected/d8e86d59-3ffe-42ef-9fed-e180416a9d50-kube-api-access-h2tl2\") pod \"d8e86d59-3ffe-42ef-9fed-e180416a9d50\" (UID: \"d8e86d59-3ffe-42ef-9fed-e180416a9d50\") "
Jul 11 01:19:09.060347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.060312    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8e86d59-3ffe-42ef-9fed-e180416a9d50-kube-api-access-h2tl2" (OuterVolumeSpecName: "kube-api-access-h2tl2") pod "d8e86d59-3ffe-42ef-9fed-e180416a9d50" (UID: "d8e86d59-3ffe-42ef-9fed-e180416a9d50"). InnerVolumeSpecName "kube-api-access-h2tl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:19:09.159750 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.159719    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2tl2\" (UniqueName: \"kubernetes.io/projected/d8e86d59-3ffe-42ef-9fed-e180416a9d50-kube-api-access-h2tl2\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:19:09.955479 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.955394    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7xv9r" event={"ID":"ab4c8f08-85ac-4172-9a85-91824d03c75e","Type":"ContainerStarted","Data":"ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd"}
Jul 11 01:19:09.955877 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.955453    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-7xv9r" podUID="ab4c8f08-85ac-4172-9a85-91824d03c75e" containerName="authorino" containerID="cri-o://ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd" gracePeriod=30
Jul 11 01:19:09.955877 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.955573    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc774d65f-fkgsj"
Jul 11 01:19:09.971409 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.971369    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-7xv9r" podStartSLOduration=1.635410771 podStartE2EDuration="1.971355376s" totalImagesPullingTime="335.944605ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:09.968628039 +0000 UTC m=+772.835596588" watchObservedRunningTime="2026-07-11 01:19:09.971355376 +0000 UTC m=+772.838323926"
Jul 11 01:19:09.990508 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.990476    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fc774d65f-fkgsj"]
Jul 11 01:19:09.992599 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:09.992576    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fc774d65f-fkgsj"]
Jul 11 01:19:10.224762 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.224733    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:10.377025 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.376992    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lptxb\" (UniqueName: \"kubernetes.io/projected/ab4c8f08-85ac-4172-9a85-91824d03c75e-kube-api-access-lptxb\") pod \"ab4c8f08-85ac-4172-9a85-91824d03c75e\" (UID: \"ab4c8f08-85ac-4172-9a85-91824d03c75e\") "
Jul 11 01:19:10.379023 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.378994    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab4c8f08-85ac-4172-9a85-91824d03c75e-kube-api-access-lptxb" (OuterVolumeSpecName: "kube-api-access-lptxb") pod "ab4c8f08-85ac-4172-9a85-91824d03c75e" (UID: "ab4c8f08-85ac-4172-9a85-91824d03c75e"). InnerVolumeSpecName "kube-api-access-lptxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:19:10.478395 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.478321    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lptxb\" (UniqueName: \"kubernetes.io/projected/ab4c8f08-85ac-4172-9a85-91824d03c75e-kube-api-access-lptxb\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:19:10.699801 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.699762    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8e86d59-3ffe-42ef-9fed-e180416a9d50" path="/var/lib/kubelet/pods/d8e86d59-3ffe-42ef-9fed-e180416a9d50/volumes"
Jul 11 01:19:10.962250 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.962191    2555 generic.go:356] "Generic (PLEG): container finished" podID="ab4c8f08-85ac-4172-9a85-91824d03c75e" containerID="ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd" exitCode=0
Jul 11 01:19:10.962700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.962256    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7xv9r"
Jul 11 01:19:10.962700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.962303    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7xv9r" event={"ID":"ab4c8f08-85ac-4172-9a85-91824d03c75e","Type":"ContainerDied","Data":"ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd"}
Jul 11 01:19:10.962700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.962346    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-7xv9r" event={"ID":"ab4c8f08-85ac-4172-9a85-91824d03c75e","Type":"ContainerDied","Data":"b404d015aa71eb51bd68b4631baf71e0d98ebb0f85892034a5e4cbe15f195ddc"}
Jul 11 01:19:10.962700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.962366    2555 scope.go:117] "RemoveContainer" containerID="ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd"
Jul 11 01:19:10.971217 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.971172    2555 scope.go:117] "RemoveContainer" containerID="ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd"
Jul 11 01:19:10.971480 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:10.971461    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd\": container with ID starting with ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd not found: ID does not exist" containerID="ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd"
Jul 11 01:19:10.971538 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.971487    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd"} err="failed to get container status \"ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd\": rpc error: code = NotFound desc = could not find container \"ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd\": container with ID starting with ab81432a8924c61399790dd25b92b61526550c7b023cc9733d23f65a6d9a47cd not found: ID does not exist"
Jul 11 01:19:10.990933 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:10.990909    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7xv9r"]
Jul 11 01:19:11.001723 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:11.001696    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7xv9r"]
Jul 11 01:19:12.698983 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:12.698946    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab4c8f08-85ac-4172-9a85-91824d03c75e" path="/var/lib/kubelet/pods/ab4c8f08-85ac-4172-9a85-91824d03c75e/volumes"
Jul 11 01:19:14.723356 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.723328    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c8f44c8-wnz9c"]
Jul 11 01:19:14.723915 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.723811    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab4c8f08-85ac-4172-9a85-91824d03c75e" containerName="authorino"
Jul 11 01:19:14.723915 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.723832    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab4c8f08-85ac-4172-9a85-91824d03c75e" containerName="authorino"
Jul 11 01:19:14.724030 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.723983    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab4c8f08-85ac-4172-9a85-91824d03c75e" containerName="authorino"
Jul 11 01:19:14.844041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.844003    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c8f44c8-wnz9c"]
Jul 11 01:19:14.844041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.844027    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:14.846467 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.846449    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 01:19:14.846567 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.846483    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j4rtr\""
Jul 11 01:19:14.846567 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.846483    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 11 01:19:14.889170 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.889134    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-558bfbff58-sz5ww"]
Jul 11 01:19:14.917450 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.917406    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:14.917629 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.917465    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl85l\" (UniqueName: \"kubernetes.io/projected/5a97956f-0abf-40f0-8f32-8313ab8b0a18-kube-api-access-nl85l\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:14.927330 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.927293    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-558bfbff58-sz5ww"]
Jul 11 01:19:14.927437 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:14.927399    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.018718 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.018614    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:15.018718 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.018687    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl85l\" (UniqueName: \"kubernetes.io/projected/5a97956f-0abf-40f0-8f32-8313ab8b0a18-kube-api-access-nl85l\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:15.018911 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.018727    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxbpd\" (UniqueName: \"kubernetes.io/projected/7cc6ee45-f173-44bb-bb98-4d14ead8987c-kube-api-access-cxbpd\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.018911 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:15.018751    2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 11 01:19:15.018911 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.018777    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.018911 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:15.018818    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert podName:5a97956f-0abf-40f0-8f32-8313ab8b0a18 nodeName:}" failed. No retries permitted until 2026-07-11 01:19:15.518797065 +0000 UTC m=+778.385765598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert") pod "maas-controller-6c8f44c8-wnz9c" (UID: "5a97956f-0abf-40f0-8f32-8313ab8b0a18") : secret "maas-controller-webhook-cert" not found
Jul 11 01:19:15.026862 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.026838    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl85l\" (UniqueName: \"kubernetes.io/projected/5a97956f-0abf-40f0-8f32-8313ab8b0a18-kube-api-access-nl85l\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:15.119836 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.119805    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxbpd\" (UniqueName: \"kubernetes.io/projected/7cc6ee45-f173-44bb-bb98-4d14ead8987c-kube-api-access-cxbpd\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.120004 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.119865    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.120087 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:15.120020    2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 11 01:19:15.120087 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:15.120084    2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert podName:7cc6ee45-f173-44bb-bb98-4d14ead8987c nodeName:}" failed. No retries permitted until 2026-07-11 01:19:15.620069509 +0000 UTC m=+778.487038042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert") pod "maas-controller-558bfbff58-sz5ww" (UID: "7cc6ee45-f173-44bb-bb98-4d14ead8987c") : secret "maas-controller-webhook-cert" not found
Jul 11 01:19:15.128410 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.128384    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxbpd\" (UniqueName: \"kubernetes.io/projected/7cc6ee45-f173-44bb-bb98-4d14ead8987c-kube-api-access-cxbpd\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.523529 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.523495    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:15.525810 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.525780    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert\") pod \"maas-controller-6c8f44c8-wnz9c\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") " pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:15.624595 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.624558    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.626840 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.626821    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert\") pod \"maas-controller-558bfbff58-sz5ww\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") " pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.754372 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.754334    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:15.837754 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.837718    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:15.946233 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.946187    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c8f44c8-wnz9c"]
Jul 11 01:19:15.951688 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:19:15.950355    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a97956f_0abf_40f0_8f32_8313ab8b0a18.slice/crio-fb5f934735693a9b8c3468cc65889a6da72118761d600bed569df2915d286859 WatchSource:0}: Error finding container fb5f934735693a9b8c3468cc65889a6da72118761d600bed569df2915d286859: Status 404 returned error can't find the container with id fb5f934735693a9b8c3468cc65889a6da72118761d600bed569df2915d286859
Jul 11 01:19:15.991974 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.991934    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c8f44c8-wnz9c" event={"ID":"5a97956f-0abf-40f0-8f32-8313ab8b0a18","Type":"ContainerStarted","Data":"fb5f934735693a9b8c3468cc65889a6da72118761d600bed569df2915d286859"}
Jul 11 01:19:15.996950 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:15.996929    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-558bfbff58-sz5ww"]
Jul 11 01:19:15.999196 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:19:15.999167    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc6ee45_f173_44bb_bb98_4d14ead8987c.slice/crio-1ef22d029d5a4dd8128c4ee2d1fec16567ab578c6cb6243ab25bab58d8e5807d WatchSource:0}: Error finding container 1ef22d029d5a4dd8128c4ee2d1fec16567ab578c6cb6243ab25bab58d8e5807d: Status 404 returned error can't find the container with id 1ef22d029d5a4dd8128c4ee2d1fec16567ab578c6cb6243ab25bab58d8e5807d
Jul 11 01:19:17.004668 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:17.004592    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-558bfbff58-sz5ww" event={"ID":"7cc6ee45-f173-44bb-bb98-4d14ead8987c","Type":"ContainerStarted","Data":"1ef22d029d5a4dd8128c4ee2d1fec16567ab578c6cb6243ab25bab58d8e5807d"}
Jul 11 01:19:18.273524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:18.273501    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 01:19:19.018520 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:19.018482    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-558bfbff58-sz5ww" event={"ID":"7cc6ee45-f173-44bb-bb98-4d14ead8987c","Type":"ContainerStarted","Data":"04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56"}
Jul 11 01:19:19.018746 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:19.018546    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:19.020116 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:19.020088    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c8f44c8-wnz9c" event={"ID":"5a97956f-0abf-40f0-8f32-8313ab8b0a18","Type":"ContainerStarted","Data":"bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db"}
Jul 11 01:19:19.020260 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:19.020152    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:19.034972 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:19.034922    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-558bfbff58-sz5ww" podStartSLOduration=2.757938319 podStartE2EDuration="5.034907827s" totalImagesPullingTime="2.276969508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:19.034253314 +0000 UTC m=+781.901221863" watchObservedRunningTime="2026-07-11 01:19:19.034907827 +0000 UTC m=+781.901876376"
Jul 11 01:19:19.055846 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:19.055789    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c8f44c8-wnz9c" podStartSLOduration=2.739310052 podStartE2EDuration="5.055774128s" totalImagesPullingTime="2.316464076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:19.053520756 +0000 UTC m=+781.920489304" watchObservedRunningTime="2026-07-11 01:19:19.055774128 +0000 UTC m=+781.922742678"
Jul 11 01:19:30.028018 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.027984    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:19:30.028527 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.028052    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:30.086623 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.086578    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c8f44c8-wnz9c"]
Jul 11 01:19:30.086842 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.086815    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c8f44c8-wnz9c" podUID="5a97956f-0abf-40f0-8f32-8313ab8b0a18" containerName="manager" containerID="cri-o://bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db" gracePeriod=30
Jul 11 01:19:30.338638 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.338603    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:30.354832 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.354801    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert\") pod \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") "
Jul 11 01:19:30.354967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.354878    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl85l\" (UniqueName: \"kubernetes.io/projected/5a97956f-0abf-40f0-8f32-8313ab8b0a18-kube-api-access-nl85l\") pod \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\" (UID: \"5a97956f-0abf-40f0-8f32-8313ab8b0a18\") "
Jul 11 01:19:30.357223 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.357176    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a97956f-0abf-40f0-8f32-8313ab8b0a18-kube-api-access-nl85l" (OuterVolumeSpecName: "kube-api-access-nl85l") pod "5a97956f-0abf-40f0-8f32-8313ab8b0a18" (UID: "5a97956f-0abf-40f0-8f32-8313ab8b0a18"). InnerVolumeSpecName "kube-api-access-nl85l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:19:30.357223 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.357215    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5a97956f-0abf-40f0-8f32-8313ab8b0a18" (UID: "5a97956f-0abf-40f0-8f32-8313ab8b0a18"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:19:30.455525 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.455491    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl85l\" (UniqueName: \"kubernetes.io/projected/5a97956f-0abf-40f0-8f32-8313ab8b0a18-kube-api-access-nl85l\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:19:30.455525 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:30.455521    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a97956f-0abf-40f0-8f32-8313ab8b0a18-webhook-cert\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:19:31.086778 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.086746    2555 generic.go:356] "Generic (PLEG): container finished" podID="5a97956f-0abf-40f0-8f32-8313ab8b0a18" containerID="bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db" exitCode=0
Jul 11 01:19:31.087156 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.086791    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c8f44c8-wnz9c"
Jul 11 01:19:31.087156 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.086821    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c8f44c8-wnz9c" event={"ID":"5a97956f-0abf-40f0-8f32-8313ab8b0a18","Type":"ContainerDied","Data":"bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db"}
Jul 11 01:19:31.087156 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.086883    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c8f44c8-wnz9c" event={"ID":"5a97956f-0abf-40f0-8f32-8313ab8b0a18","Type":"ContainerDied","Data":"fb5f934735693a9b8c3468cc65889a6da72118761d600bed569df2915d286859"}
Jul 11 01:19:31.087156 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.086908    2555 scope.go:117] "RemoveContainer" containerID="bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db"
Jul 11 01:19:31.095760 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.095737    2555 scope.go:117] "RemoveContainer" containerID="bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db"
Jul 11 01:19:31.096016 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:19:31.095997    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db\": container with ID starting with bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db not found: ID does not exist" containerID="bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db"
Jul 11 01:19:31.096072 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.096025    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db"} err="failed to get container status \"bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db\": rpc error: code = NotFound desc = could not find container \"bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db\": container with ID starting with bafcb22a7a21e1be0104e8d4f0775867706fd2e00df62e2819dfe5f196bef6db not found: ID does not exist"
Jul 11 01:19:31.104248 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.104225    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c8f44c8-wnz9c"]
Jul 11 01:19:31.110943 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:31.110914    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c8f44c8-wnz9c"]
Jul 11 01:19:32.700273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:32.700235    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a97956f-0abf-40f0-8f32-8313ab8b0a18" path="/var/lib/kubelet/pods/5a97956f-0abf-40f0-8f32-8313ab8b0a18/volumes"
Jul 11 01:19:51.219043 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.218960    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"]
Jul 11 01:19:51.219517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.219388    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a97956f-0abf-40f0-8f32-8313ab8b0a18" containerName="manager"
Jul 11 01:19:51.219517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.219403    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a97956f-0abf-40f0-8f32-8313ab8b0a18" containerName="manager"
Jul 11 01:19:51.219517 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.219477    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a97956f-0abf-40f0-8f32-8313ab8b0a18" containerName="manager"
Jul 11 01:19:51.229596 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.229565    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.232344 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.232316    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 11 01:19:51.232484 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.232387    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zfwtg\""
Jul 11 01:19:51.232573 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.232547    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"]
Jul 11 01:19:51.333322 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.333285    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be57b10a-a313-459a-9ebd-2f3223ac456c-maas-api-tls\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.333505 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.333332    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m57rx\" (UniqueName: \"kubernetes.io/projected/be57b10a-a313-459a-9ebd-2f3223ac456c-kube-api-access-m57rx\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.333505 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.333358    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be57b10a-a313-459a-9ebd-2f3223ac456c-openshift-service-ca\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.434727 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.434697    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be57b10a-a313-459a-9ebd-2f3223ac456c-maas-api-tls\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.434906 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.434748    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m57rx\" (UniqueName: \"kubernetes.io/projected/be57b10a-a313-459a-9ebd-2f3223ac456c-kube-api-access-m57rx\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.434906 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.434787    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be57b10a-a313-459a-9ebd-2f3223ac456c-openshift-service-ca\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.435470 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.435445    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be57b10a-a313-459a-9ebd-2f3223ac456c-openshift-service-ca\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.437119 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.437100    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be57b10a-a313-459a-9ebd-2f3223ac456c-maas-api-tls\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.444028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.444005    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m57rx\" (UniqueName: \"kubernetes.io/projected/be57b10a-a313-459a-9ebd-2f3223ac456c-kube-api-access-m57rx\") pod \"maas-api-5cb5b66ff-mc28f\" (UID: \"be57b10a-a313-459a-9ebd-2f3223ac456c\") " pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.542129 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.542068    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:51.673963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.673934    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"]
Jul 11 01:19:51.679577 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.679554    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.682710 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.682630    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 11 01:19:51.682710 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.682700    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s27r8\""
Jul 11 01:19:51.688133 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.688110    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"]
Jul 11 01:19:51.698316 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.698291    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"]
Jul 11 01:19:51.699708 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:19:51.699664    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe57b10a_a313_459a_9ebd_2f3223ac456c.slice/crio-82bd5170e62f8213efbb9e8881d731f5fcc6136e816daae963fc0b5b730c182a WatchSource:0}: Error finding container 82bd5170e62f8213efbb9e8881d731f5fcc6136e816daae963fc0b5b730c182a: Status 404 returned error can't find the container with id 82bd5170e62f8213efbb9e8881d731f5fcc6136e816daae963fc0b5b730c182a
Jul 11 01:19:51.705255 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.705233    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-2g597"]
Jul 11 01:19:51.709716 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.709698    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.714597 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.714575    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-2g597"]
Jul 11 01:19:51.736500 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.736473    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7p4d\" (UniqueName: \"kubernetes.io/projected/eda7919e-1048-45b4-b8cb-8f75a2f0c4bc-kube-api-access-z7p4d\") pod \"payload-pre-processing-74584bb9f8-qrm2j\" (UID: \"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.736709 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.736685    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eda7919e-1048-45b4-b8cb-8f75a2f0c4bc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qrm2j\" (UID: \"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.837425 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.837311    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eda7919e-1048-45b4-b8cb-8f75a2f0c4bc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qrm2j\" (UID: \"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.837425 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.837397    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b20d699-5da3-4d25-b514-e25b8a8d9c0d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-2g597\" (UID: \"7b20d699-5da3-4d25-b514-e25b8a8d9c0d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.837650 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.837442    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7p4d\" (UniqueName: \"kubernetes.io/projected/eda7919e-1048-45b4-b8cb-8f75a2f0c4bc-kube-api-access-z7p4d\") pod \"payload-pre-processing-74584bb9f8-qrm2j\" (UID: \"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.837650 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.837474    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7v8k\" (UniqueName: \"kubernetes.io/projected/7b20d699-5da3-4d25-b514-e25b8a8d9c0d-kube-api-access-t7v8k\") pod \"payload-processing-f9b8d9b9b-2g597\" (UID: \"7b20d699-5da3-4d25-b514-e25b8a8d9c0d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.838037 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.838015    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eda7919e-1048-45b4-b8cb-8f75a2f0c4bc-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qrm2j\" (UID: \"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.845455 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.845431    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7p4d\" (UniqueName: \"kubernetes.io/projected/eda7919e-1048-45b4-b8cb-8f75a2f0c4bc-kube-api-access-z7p4d\") pod \"payload-pre-processing-74584bb9f8-qrm2j\" (UID: \"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:51.938315 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.938279    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7v8k\" (UniqueName: \"kubernetes.io/projected/7b20d699-5da3-4d25-b514-e25b8a8d9c0d-kube-api-access-t7v8k\") pod \"payload-processing-f9b8d9b9b-2g597\" (UID: \"7b20d699-5da3-4d25-b514-e25b8a8d9c0d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.938477 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.938405    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b20d699-5da3-4d25-b514-e25b8a8d9c0d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-2g597\" (UID: \"7b20d699-5da3-4d25-b514-e25b8a8d9c0d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.939108 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.939090    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b20d699-5da3-4d25-b514-e25b8a8d9c0d-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-2g597\" (UID: \"7b20d699-5da3-4d25-b514-e25b8a8d9c0d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.946328 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.946305    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7v8k\" (UniqueName: \"kubernetes.io/projected/7b20d699-5da3-4d25-b514-e25b8a8d9c0d-kube-api-access-t7v8k\") pod \"payload-processing-f9b8d9b9b-2g597\" (UID: \"7b20d699-5da3-4d25-b514-e25b8a8d9c0d\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:51.996454 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:51.996416    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:52.021230 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:52.021173    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:52.151050 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:52.151018    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"]
Jul 11 01:19:52.153122 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:19:52.153097    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda7919e_1048_45b4_b8cb_8f75a2f0c4bc.slice/crio-7446ebaa449b3b0d1d46415b59f750cbfbe757e19afaadd4466404a9a92bb327 WatchSource:0}: Error finding container 7446ebaa449b3b0d1d46415b59f750cbfbe757e19afaadd4466404a9a92bb327: Status 404 returned error can't find the container with id 7446ebaa449b3b0d1d46415b59f750cbfbe757e19afaadd4466404a9a92bb327
Jul 11 01:19:52.169069 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:52.169043    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-2g597"]
Jul 11 01:19:52.170350 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:19:52.170323    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b20d699_5da3_4d25_b514_e25b8a8d9c0d.slice/crio-7d9bdc8aab86fa243babd044747d44394d7d6fd812fe61dcbd6b5f6f1241c40b WatchSource:0}: Error finding container 7d9bdc8aab86fa243babd044747d44394d7d6fd812fe61dcbd6b5f6f1241c40b: Status 404 returned error can't find the container with id 7d9bdc8aab86fa243babd044747d44394d7d6fd812fe61dcbd6b5f6f1241c40b
Jul 11 01:19:52.200792 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:52.200752    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597" event={"ID":"7b20d699-5da3-4d25-b514-e25b8a8d9c0d","Type":"ContainerStarted","Data":"7d9bdc8aab86fa243babd044747d44394d7d6fd812fe61dcbd6b5f6f1241c40b"}
Jul 11 01:19:52.202253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:52.202197    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f" event={"ID":"be57b10a-a313-459a-9ebd-2f3223ac456c","Type":"ContainerStarted","Data":"82bd5170e62f8213efbb9e8881d731f5fcc6136e816daae963fc0b5b730c182a"}
Jul 11 01:19:52.203474 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:52.203453    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j" event={"ID":"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc","Type":"ContainerStarted","Data":"7446ebaa449b3b0d1d46415b59f750cbfbe757e19afaadd4466404a9a92bb327"}
Jul 11 01:19:54.216617 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.216578    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f" event={"ID":"be57b10a-a313-459a-9ebd-2f3223ac456c","Type":"ContainerStarted","Data":"5818beda229fa8df37cc5e0684611bbc790292873f7eb78f598364c98f1edda6"}
Jul 11 01:19:54.217070 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.216733    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:19:54.218156 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.218133    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j" event={"ID":"eda7919e-1048-45b4-b8cb-8f75a2f0c4bc","Type":"ContainerStarted","Data":"049ee166afb8c224e70195a7e1647458fd49648f399a2023d1cb2ba071836b79"}
Jul 11 01:19:54.218301 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.218247    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:19:54.219541 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.219519    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597" event={"ID":"7b20d699-5da3-4d25-b514-e25b8a8d9c0d","Type":"ContainerStarted","Data":"5db260b6a3d07ac6085f43656a0c89de47ef3e65840983a8583c8a16c051fcef"}
Jul 11 01:19:54.219643 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.219631    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:19:54.233356 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.233314    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f" podStartSLOduration=1.141383152 podStartE2EDuration="3.233302702s" totalImagesPullingTime="2.09191955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:54.231542227 +0000 UTC m=+817.098510790" watchObservedRunningTime="2026-07-11 01:19:54.233302702 +0000 UTC m=+817.100271251"
Jul 11 01:19:54.245273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.245049    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j" podStartSLOduration=1.606736411 podStartE2EDuration="3.245034514s" totalImagesPullingTime="1.638298103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:54.24501484 +0000 UTC m=+817.111983392" watchObservedRunningTime="2026-07-11 01:19:54.245034514 +0000 UTC m=+817.112003064"
Jul 11 01:19:54.265635 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:19:54.265580    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597" podStartSLOduration=1.64189339 podStartE2EDuration="3.265562791s" totalImagesPullingTime="1.623669401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:19:54.262394347 +0000 UTC m=+817.129362901" watchObservedRunningTime="2026-07-11 01:19:54.265562791 +0000 UTC m=+817.132531343"
Jul 11 01:20:00.230536 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:00.230507    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5cb5b66ff-mc28f"
Jul 11 01:20:05.227809 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:05.227769    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-2g597"
Jul 11 01:20:05.228239 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:05.227942    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qrm2j"
Jul 11 01:20:28.803581 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.803536    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"]
Jul 11 01:20:28.810298 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.810277    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.813996 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.813971    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 11 01:20:28.814313 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.814052    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 11 01:20:28.814313 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.814096    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 11 01:20:28.814313 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.814243    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zgpm8\""
Jul 11 01:20:28.818124 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.818098    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"]
Jul 11 01:20:28.864580 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.864543    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57c617a-3f40-4aa1-8edc-7de23c868a2a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.864730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.864608    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.864730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.864644    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtdk2\" (UniqueName: \"kubernetes.io/projected/d57c617a-3f40-4aa1-8edc-7de23c868a2a-kube-api-access-gtdk2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.864730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.864678    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.864730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.864696    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.864730 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.864710    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965161 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965122    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965161 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965158    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965438 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965177    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965438 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965318    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57c617a-3f40-4aa1-8edc-7de23c868a2a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965438 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965407    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965604 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtdk2\" (UniqueName: \"kubernetes.io/projected/d57c617a-3f40-4aa1-8edc-7de23c868a2a-kube-api-access-gtdk2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965668 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965602    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965724 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965681    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.965764 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.965717    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.967590 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.967568    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57c617a-3f40-4aa1-8edc-7de23c868a2a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.967735 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.967718    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57c617a-3f40-4aa1-8edc-7de23c868a2a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:28.976944 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:28.976916    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtdk2\" (UniqueName: \"kubernetes.io/projected/d57c617a-3f40-4aa1-8edc-7de23c868a2a-kube-api-access-gtdk2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2d62d\" (UID: \"d57c617a-3f40-4aa1-8edc-7de23c868a2a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:29.122305 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:29.122197    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:29.264001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:29.263972    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"]
Jul 11 01:20:29.266739 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:20:29.266710    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57c617a_3f40_4aa1_8edc_7de23c868a2a.slice/crio-bf77e9c82e89fab24d629d621bce847d091aa6fcf65bdfa665ae9d850c3eed63 WatchSource:0}: Error finding container bf77e9c82e89fab24d629d621bce847d091aa6fcf65bdfa665ae9d850c3eed63: Status 404 returned error can't find the container with id bf77e9c82e89fab24d629d621bce847d091aa6fcf65bdfa665ae9d850c3eed63
Jul 11 01:20:29.426977 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:29.426880    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d" event={"ID":"d57c617a-3f40-4aa1-8edc-7de23c868a2a","Type":"ContainerStarted","Data":"bf77e9c82e89fab24d629d621bce847d091aa6fcf65bdfa665ae9d850c3eed63"}
Jul 11 01:20:30.433507 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:30.433474    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d" event={"ID":"d57c617a-3f40-4aa1-8edc-7de23c868a2a","Type":"ContainerStarted","Data":"35ecf30807eece8f63b2de83a1ca219ddb6d376aa51bfd3ec048b74db0f45b18"}
Jul 11 01:20:30.453770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:30.453719    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d" podStartSLOduration=1.445931402 podStartE2EDuration="2.453703132s" totalImagesPullingTime="1.00777173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:20:30.450499672 +0000 UTC m=+853.317468223" watchObservedRunningTime="2026-07-11 01:20:30.453703132 +0000 UTC m=+853.320671997"
Jul 11 01:20:39.123263 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:39.123198    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:39.123685 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:39.123289    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:39.135887 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:39.135860    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:39.494894 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:39.494811    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2d62d"
Jul 11 01:20:56.106497 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.106458    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"]
Jul 11 01:20:56.110370 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.110350    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.113254 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.113222    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 11 01:20:56.124647 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.124615    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"]
Jul 11 01:20:56.220465 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.220431    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.220465 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.220479    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.220687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.220539    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.220687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.220562    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.220687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.220608    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qjm\" (UniqueName: \"kubernetes.io/projected/ff6280a5-8403-490b-9a29-634cc8b62b6f-kube-api-access-s7qjm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.220687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.220630    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6280a5-8403-490b-9a29-634cc8b62b6f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322067 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322030    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322078    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322109    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322133    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322193    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qjm\" (UniqueName: \"kubernetes.io/projected/ff6280a5-8403-490b-9a29-634cc8b62b6f-kube-api-access-s7qjm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322259    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6280a5-8403-490b-9a29-634cc8b62b6f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322633 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322603    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322707 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322653    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.322765 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.322734    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.325110 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.325088    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff6280a5-8403-490b-9a29-634cc8b62b6f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.325412 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.325394    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff6280a5-8403-490b-9a29-634cc8b62b6f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.329873 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.329845    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qjm\" (UniqueName: \"kubernetes.io/projected/ff6280a5-8403-490b-9a29-634cc8b62b6f-kube-api-access-s7qjm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg\" (UID: \"ff6280a5-8403-490b-9a29-634cc8b62b6f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.429142 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.429029    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:20:56.571645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.571606    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"]
Jul 11 01:20:56.572184 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:20:56.572155    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6280a5_8403_490b_9a29_634cc8b62b6f.slice/crio-a219507e123ed0622eed96fc21af370cf39bb7ed19321f2c43ca7df23b19cc32 WatchSource:0}: Error finding container a219507e123ed0622eed96fc21af370cf39bb7ed19321f2c43ca7df23b19cc32: Status 404 returned error can't find the container with id a219507e123ed0622eed96fc21af370cf39bb7ed19321f2c43ca7df23b19cc32
Jul 11 01:20:56.580894 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:56.580864    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg" event={"ID":"ff6280a5-8403-490b-9a29-634cc8b62b6f","Type":"ContainerStarted","Data":"a219507e123ed0622eed96fc21af370cf39bb7ed19321f2c43ca7df23b19cc32"}
Jul 11 01:20:57.587359 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:57.587322    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg" event={"ID":"ff6280a5-8403-490b-9a29-634cc8b62b6f","Type":"ContainerStarted","Data":"91b27acc4ff2a187569f5762d5add56c8abe09ccb3068d6beeea0e41cdb53245"}
Jul 11 01:20:57.604148 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:20:57.604095    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg" podStartSLOduration=1.419797418 podStartE2EDuration="1.604080838s" totalImagesPullingTime="184.28342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:20:57.601970511 +0000 UTC m=+880.468939058" watchObservedRunningTime="2026-07-11 01:20:57.604080838 +0000 UTC m=+880.471049388"
Jul 11 01:21:06.429234 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:21:06.429177    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:21:06.429718 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:21:06.429268    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:21:06.441565 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:21:06.441535    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:21:06.648844 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:21:06.648797    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg"
Jul 11 01:21:17.731537 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:21:17.731507    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:21:17.734999 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:21:17.734978    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:22:17.953909 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:17.953878    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f9747f6c4-29gcx"]
Jul 11 01:22:17.957516 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:17.957492    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:17.961306 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:17.961281    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dmtrn\""
Jul 11 01:22:17.961439 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:17.961343    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 11 01:22:17.965516 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:17.965493    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f9747f6c4-29gcx"]
Jul 11 01:22:18.053296 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.053261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1274cbef-1dc3-4a34-b523-d95d8323e726-tls-cert\") pod \"authorino-f9747f6c4-29gcx\" (UID: \"1274cbef-1dc3-4a34-b523-d95d8323e726\") " pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.053457 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.053372    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djwrc\" (UniqueName: \"kubernetes.io/projected/1274cbef-1dc3-4a34-b523-d95d8323e726-kube-api-access-djwrc\") pod \"authorino-f9747f6c4-29gcx\" (UID: \"1274cbef-1dc3-4a34-b523-d95d8323e726\") " pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.154851 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.154811    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djwrc\" (UniqueName: \"kubernetes.io/projected/1274cbef-1dc3-4a34-b523-d95d8323e726-kube-api-access-djwrc\") pod \"authorino-f9747f6c4-29gcx\" (UID: \"1274cbef-1dc3-4a34-b523-d95d8323e726\") " pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.155058 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.154886    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1274cbef-1dc3-4a34-b523-d95d8323e726-tls-cert\") pod \"authorino-f9747f6c4-29gcx\" (UID: \"1274cbef-1dc3-4a34-b523-d95d8323e726\") " pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.157487 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.157455    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1274cbef-1dc3-4a34-b523-d95d8323e726-tls-cert\") pod \"authorino-f9747f6c4-29gcx\" (UID: \"1274cbef-1dc3-4a34-b523-d95d8323e726\") " pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.162530 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.162501    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djwrc\" (UniqueName: \"kubernetes.io/projected/1274cbef-1dc3-4a34-b523-d95d8323e726-kube-api-access-djwrc\") pod \"authorino-f9747f6c4-29gcx\" (UID: \"1274cbef-1dc3-4a34-b523-d95d8323e726\") " pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.269884 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.269792    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f9747f6c4-29gcx"
Jul 11 01:22:18.409121 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.409100    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f9747f6c4-29gcx"]
Jul 11 01:22:18.411151 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:22:18.411125    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1274cbef_1dc3_4a34_b523_d95d8323e726.slice/crio-851863aa8edf4312e2f8ec6e36c7b9e9d4747bacf9bdae4aae0c30c0950c861a WatchSource:0}: Error finding container 851863aa8edf4312e2f8ec6e36c7b9e9d4747bacf9bdae4aae0c30c0950c861a: Status 404 returned error can't find the container with id 851863aa8edf4312e2f8ec6e36c7b9e9d4747bacf9bdae4aae0c30c0950c861a
Jul 11 01:22:18.412914 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:18.412897    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:22:19.041910 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:19.041856    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f9747f6c4-29gcx" event={"ID":"1274cbef-1dc3-4a34-b523-d95d8323e726","Type":"ContainerStarted","Data":"172c1233fa81dd332194252c9f533a695a61f3dd0ef95e9c2131e6047be892bd"}
Jul 11 01:22:19.042279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:19.041919    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f9747f6c4-29gcx" event={"ID":"1274cbef-1dc3-4a34-b523-d95d8323e726","Type":"ContainerStarted","Data":"851863aa8edf4312e2f8ec6e36c7b9e9d4747bacf9bdae4aae0c30c0950c861a"}
Jul 11 01:22:19.077594 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:22:19.077544    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f9747f6c4-29gcx" podStartSLOduration=1.6141574890000001 podStartE2EDuration="2.077526786s" totalImagesPullingTime="463.369297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:22:19.075576626 +0000 UTC m=+961.942545168" watchObservedRunningTime="2026-07-11 01:22:19.077526786 +0000 UTC m=+961.944495334"
Jul 11 01:23:29.505872 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.505836    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-558bfbff58-sz5ww"]
Jul 11 01:23:29.506546 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.506027    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-558bfbff58-sz5ww" podUID="7cc6ee45-f173-44bb-bb98-4d14ead8987c" containerName="manager" containerID="cri-o://04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56" gracePeriod=30
Jul 11 01:23:29.771037 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.770966    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:23:29.895092 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.895053    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxbpd\" (UniqueName: \"kubernetes.io/projected/7cc6ee45-f173-44bb-bb98-4d14ead8987c-kube-api-access-cxbpd\") pod \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") "
Jul 11 01:23:29.895307 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.895110    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert\") pod \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\" (UID: \"7cc6ee45-f173-44bb-bb98-4d14ead8987c\") "
Jul 11 01:23:29.897290 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.897257    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc6ee45-f173-44bb-bb98-4d14ead8987c-kube-api-access-cxbpd" (OuterVolumeSpecName: "kube-api-access-cxbpd") pod "7cc6ee45-f173-44bb-bb98-4d14ead8987c" (UID: "7cc6ee45-f173-44bb-bb98-4d14ead8987c"). InnerVolumeSpecName "kube-api-access-cxbpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:23:29.897372 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.897300    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7cc6ee45-f173-44bb-bb98-4d14ead8987c" (UID: "7cc6ee45-f173-44bb-bb98-4d14ead8987c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:23:29.996423 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.996381    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxbpd\" (UniqueName: \"kubernetes.io/projected/7cc6ee45-f173-44bb-bb98-4d14ead8987c-kube-api-access-cxbpd\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:23:29.996423 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:29.996415    2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc6ee45-f173-44bb-bb98-4d14ead8987c-webhook-cert\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:23:30.460973 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.460936    2555 generic.go:356] "Generic (PLEG): container finished" podID="7cc6ee45-f173-44bb-bb98-4d14ead8987c" containerID="04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56" exitCode=0
Jul 11 01:23:30.461187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.460982    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-558bfbff58-sz5ww"
Jul 11 01:23:30.461187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.461019    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-558bfbff58-sz5ww" event={"ID":"7cc6ee45-f173-44bb-bb98-4d14ead8987c","Type":"ContainerDied","Data":"04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56"}
Jul 11 01:23:30.461187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.461074    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-558bfbff58-sz5ww" event={"ID":"7cc6ee45-f173-44bb-bb98-4d14ead8987c","Type":"ContainerDied","Data":"1ef22d029d5a4dd8128c4ee2d1fec16567ab578c6cb6243ab25bab58d8e5807d"}
Jul 11 01:23:30.461187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.461098    2555 scope.go:117] "RemoveContainer" containerID="04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56"
Jul 11 01:23:30.471092 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.471072    2555 scope.go:117] "RemoveContainer" containerID="04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56"
Jul 11 01:23:30.471414 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:23:30.471394    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56\": container with ID starting with 04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56 not found: ID does not exist" containerID="04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56"
Jul 11 01:23:30.471509 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.471429    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56"} err="failed to get container status \"04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56\": rpc error: code = NotFound desc = could not find container \"04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56\": container with ID starting with 04ad70fd60025affaa11da899384bf8b82ca98e5954262041b23326b50ca9e56 not found: ID does not exist"
Jul 11 01:23:30.485982 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.485945    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-558bfbff58-sz5ww"]
Jul 11 01:23:30.492161 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.492131    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-558bfbff58-sz5ww"]
Jul 11 01:23:30.700570 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:30.700536    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc6ee45-f173-44bb-bb98-4d14ead8987c" path="/var/lib/kubelet/pods/7cc6ee45-f173-44bb-bb98-4d14ead8987c/volumes"
Jul 11 01:23:31.242634 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.242597    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-558bfbff58-m2rxb"]
Jul 11 01:23:31.243034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.243021    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc6ee45-f173-44bb-bb98-4d14ead8987c" containerName="manager"
Jul 11 01:23:31.243081 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.243036    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc6ee45-f173-44bb-bb98-4d14ead8987c" containerName="manager"
Jul 11 01:23:31.243117 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.243098    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc6ee45-f173-44bb-bb98-4d14ead8987c" containerName="manager"
Jul 11 01:23:31.247477 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.247459    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.251324 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.251299    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 11 01:23:31.251464 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.251346    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j4rtr\""
Jul 11 01:23:31.251903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.251302    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 11 01:23:31.255469 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.255445    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-558bfbff58-m2rxb"]
Jul 11 01:23:31.406702 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.406661    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29cd4\" (UniqueName: \"kubernetes.io/projected/35ad9b2e-9a27-45ab-8b6b-766957c41b76-kube-api-access-29cd4\") pod \"maas-controller-558bfbff58-m2rxb\" (UID: \"35ad9b2e-9a27-45ab-8b6b-766957c41b76\") " pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.406903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.406717    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35ad9b2e-9a27-45ab-8b6b-766957c41b76-webhook-cert\") pod \"maas-controller-558bfbff58-m2rxb\" (UID: \"35ad9b2e-9a27-45ab-8b6b-766957c41b76\") " pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.507537 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.507447    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29cd4\" (UniqueName: \"kubernetes.io/projected/35ad9b2e-9a27-45ab-8b6b-766957c41b76-kube-api-access-29cd4\") pod \"maas-controller-558bfbff58-m2rxb\" (UID: \"35ad9b2e-9a27-45ab-8b6b-766957c41b76\") " pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.507537 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.507495    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35ad9b2e-9a27-45ab-8b6b-766957c41b76-webhook-cert\") pod \"maas-controller-558bfbff58-m2rxb\" (UID: \"35ad9b2e-9a27-45ab-8b6b-766957c41b76\") " pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.509916 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.509889    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35ad9b2e-9a27-45ab-8b6b-766957c41b76-webhook-cert\") pod \"maas-controller-558bfbff58-m2rxb\" (UID: \"35ad9b2e-9a27-45ab-8b6b-766957c41b76\") " pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.516284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.516260    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29cd4\" (UniqueName: \"kubernetes.io/projected/35ad9b2e-9a27-45ab-8b6b-766957c41b76-kube-api-access-29cd4\") pod \"maas-controller-558bfbff58-m2rxb\" (UID: \"35ad9b2e-9a27-45ab-8b6b-766957c41b76\") " pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.560555 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.560524    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:31.695392 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:31.695360    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-558bfbff58-m2rxb"]
Jul 11 01:23:31.697348 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:23:31.697323    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ad9b2e_9a27_45ab_8b6b_766957c41b76.slice/crio-02a5520f380f40c31081a99bb8ca57dc28a95fb301a1a5070229965f372c8adb WatchSource:0}: Error finding container 02a5520f380f40c31081a99bb8ca57dc28a95fb301a1a5070229965f372c8adb: Status 404 returned error can't find the container with id 02a5520f380f40c31081a99bb8ca57dc28a95fb301a1a5070229965f372c8adb
Jul 11 01:23:32.475232 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:32.475170    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-558bfbff58-m2rxb" event={"ID":"35ad9b2e-9a27-45ab-8b6b-766957c41b76","Type":"ContainerStarted","Data":"09738adcfe4e2e27450faf9e10eafb755113bff00bccc81593f2361df0f627b8"}
Jul 11 01:23:32.475645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:32.475349    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:23:32.475645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:32.475403    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-558bfbff58-m2rxb" event={"ID":"35ad9b2e-9a27-45ab-8b6b-766957c41b76","Type":"ContainerStarted","Data":"02a5520f380f40c31081a99bb8ca57dc28a95fb301a1a5070229965f372c8adb"}
Jul 11 01:23:32.491631 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:32.491580    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-558bfbff58-m2rxb" podStartSLOduration=0.939603407 podStartE2EDuration="1.491563918s" totalImagesPullingTime="551.960511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:23:32.49067655 +0000 UTC m=+1035.357645101" watchObservedRunningTime="2026-07-11 01:23:32.491563918 +0000 UTC m=+1035.358532468"
Jul 11 01:23:43.483816 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:23:43.483785    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-558bfbff58-m2rxb"
Jul 11 01:26:17.769577 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:26:17.769492    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:26:17.775424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:26:17.775403    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:28:29.785975 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:29.785935    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"]
Jul 11 01:28:29.788678 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:29.786176    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq" podUID="b59870fe-7b91-458f-84ce-54cb7373fa80" containerName="manager" containerID="cri-o://0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce" gracePeriod=10
Jul 11 01:28:33.452731 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.452703    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:28:33.576912 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.576875    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b59870fe-7b91-458f-84ce-54cb7373fa80-extensions-socket-volume\") pod \"b59870fe-7b91-458f-84ce-54cb7373fa80\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") "
Jul 11 01:28:33.577123 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.576995    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb9fz\" (UniqueName: \"kubernetes.io/projected/b59870fe-7b91-458f-84ce-54cb7373fa80-kube-api-access-vb9fz\") pod \"b59870fe-7b91-458f-84ce-54cb7373fa80\" (UID: \"b59870fe-7b91-458f-84ce-54cb7373fa80\") "
Jul 11 01:28:33.577370 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.577346    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b59870fe-7b91-458f-84ce-54cb7373fa80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b59870fe-7b91-458f-84ce-54cb7373fa80" (UID: "b59870fe-7b91-458f-84ce-54cb7373fa80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:28:33.578977 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.578960    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b59870fe-7b91-458f-84ce-54cb7373fa80-kube-api-access-vb9fz" (OuterVolumeSpecName: "kube-api-access-vb9fz") pod "b59870fe-7b91-458f-84ce-54cb7373fa80" (UID: "b59870fe-7b91-458f-84ce-54cb7373fa80"). InnerVolumeSpecName "kube-api-access-vb9fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:28:33.677975 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.677935    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb9fz\" (UniqueName: \"kubernetes.io/projected/b59870fe-7b91-458f-84ce-54cb7373fa80-kube-api-access-vb9fz\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:28:33.677975 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:33.677970    2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b59870fe-7b91-458f-84ce-54cb7373fa80-extensions-socket-volume\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:28:34.246759 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.246721    2555 generic.go:356] "Generic (PLEG): container finished" podID="b59870fe-7b91-458f-84ce-54cb7373fa80" containerID="0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce" exitCode=0
Jul 11 01:28:34.246947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.246769    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"
Jul 11 01:28:34.246947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.246807    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq" event={"ID":"b59870fe-7b91-458f-84ce-54cb7373fa80","Type":"ContainerDied","Data":"0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce"}
Jul 11 01:28:34.246947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.246865    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq" event={"ID":"b59870fe-7b91-458f-84ce-54cb7373fa80","Type":"ContainerDied","Data":"c30eee006b64dc7133a6d56f8f9d0ce39140907ed02bf76f769e95b24907da9c"}
Jul 11 01:28:34.246947 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.246894    2555 scope.go:117] "RemoveContainer" containerID="0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce"
Jul 11 01:28:34.259001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.258983    2555 scope.go:117] "RemoveContainer" containerID="0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce"
Jul 11 01:28:34.259287 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:28:34.259266    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce\": container with ID starting with 0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce not found: ID does not exist" containerID="0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce"
Jul 11 01:28:34.259370 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.259293    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce"} err="failed to get container status \"0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce\": rpc error: code = NotFound desc = could not find container \"0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce\": container with ID starting with 0ffec26aa54e97ac811c5e77e801e8ee08eee5e5a31099d0c13ac21f5ee112ce not found: ID does not exist"
Jul 11 01:28:34.268137 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.268111    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"]
Jul 11 01:28:34.271676 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.271648    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zhptq"]
Jul 11 01:28:34.699791 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:28:34.699754    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b59870fe-7b91-458f-84ce-54cb7373fa80" path="/var/lib/kubelet/pods/b59870fe-7b91-458f-84ce-54cb7373fa80/volumes"
Jul 11 01:29:30.994618 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:30.994585    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"]
Jul 11 01:29:30.995026 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:30.994998    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b59870fe-7b91-458f-84ce-54cb7373fa80" containerName="manager"
Jul 11 01:29:30.995026 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:30.995010    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b59870fe-7b91-458f-84ce-54cb7373fa80" containerName="manager"
Jul 11 01:29:30.995099 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:30.995087    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b59870fe-7b91-458f-84ce-54cb7373fa80" containerName="manager"
Jul 11 01:29:30.999638 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:30.999620    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.002045 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.002025    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z6jqj\""
Jul 11 01:29:31.008839 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.008816    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"]
Jul 11 01:29:31.187058 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.187014    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428ff5b7-7da5-489d-a05c-ec0d5e616bde-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-krm4s\" (UID: \"428ff5b7-7da5-489d-a05c-ec0d5e616bde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.187265 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.187081    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4grg\" (UniqueName: \"kubernetes.io/projected/428ff5b7-7da5-489d-a05c-ec0d5e616bde-kube-api-access-x4grg\") pod \"kuadrant-operator-controller-manager-86878c769f-krm4s\" (UID: \"428ff5b7-7da5-489d-a05c-ec0d5e616bde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.288539 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.288509    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428ff5b7-7da5-489d-a05c-ec0d5e616bde-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-krm4s\" (UID: \"428ff5b7-7da5-489d-a05c-ec0d5e616bde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.288700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.288574    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4grg\" (UniqueName: \"kubernetes.io/projected/428ff5b7-7da5-489d-a05c-ec0d5e616bde-kube-api-access-x4grg\") pod \"kuadrant-operator-controller-manager-86878c769f-krm4s\" (UID: \"428ff5b7-7da5-489d-a05c-ec0d5e616bde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.288893 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.288873    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428ff5b7-7da5-489d-a05c-ec0d5e616bde-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-krm4s\" (UID: \"428ff5b7-7da5-489d-a05c-ec0d5e616bde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.300282 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.300259    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4grg\" (UniqueName: \"kubernetes.io/projected/428ff5b7-7da5-489d-a05c-ec0d5e616bde-kube-api-access-x4grg\") pod \"kuadrant-operator-controller-manager-86878c769f-krm4s\" (UID: \"428ff5b7-7da5-489d-a05c-ec0d5e616bde\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.311083 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.311063    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.455251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.455223    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"]
Jul 11 01:29:31.457096 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:29:31.457068    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428ff5b7_7da5_489d_a05c_ec0d5e616bde.slice/crio-637c21f4f58603f50b2d9e1fdfb9961e33d62e0400d7942aebe4cbe635f84f01 WatchSource:0}: Error finding container 637c21f4f58603f50b2d9e1fdfb9961e33d62e0400d7942aebe4cbe635f84f01: Status 404 returned error can't find the container with id 637c21f4f58603f50b2d9e1fdfb9961e33d62e0400d7942aebe4cbe635f84f01
Jul 11 01:29:31.573840 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.573747    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s" event={"ID":"428ff5b7-7da5-489d-a05c-ec0d5e616bde","Type":"ContainerStarted","Data":"30f3c69093332f5ce941f0d2866ec583c859a43cd6a96c0f71f43710a32a8a6e"}
Jul 11 01:29:31.573840 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.573800    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s" event={"ID":"428ff5b7-7da5-489d-a05c-ec0d5e616bde","Type":"ContainerStarted","Data":"637c21f4f58603f50b2d9e1fdfb9961e33d62e0400d7942aebe4cbe635f84f01"}
Jul 11 01:29:31.574028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.573851    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:29:31.592344 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:31.592297    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s" podStartSLOduration=1.592282424 podStartE2EDuration="1.592282424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:29:31.590925292 +0000 UTC m=+1394.457893853" watchObservedRunningTime="2026-07-11 01:29:31.592282424 +0000 UTC m=+1394.459251045"
Jul 11 01:29:42.581657 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:29:42.581625    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-krm4s"
Jul 11 01:31:17.809088 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:31:17.809060    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:31:17.816355 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:31:17.816331    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:36:17.847863 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:36:17.847834    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:36:17.855733 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:36:17.855710    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:39:42.852524 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:42.852486    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"]
Jul 11 01:39:42.855921 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:42.855898    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:42.858377 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:42.858353    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:39:42.864242 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:42.863825    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"]
Jul 11 01:39:42.976671 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:42.976618    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz\" (UID: \"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:43.077850 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:43.077815    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz\" (UID: \"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:43.078518 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:43.078490    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz\" (UID: \"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:43.168934 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:43.168853    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:43.303582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:43.303555    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"]
Jul 11 01:39:43.305016 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:39:43.304986    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40a0cbe_d170_4a66_ba7b_4dc1c9b9e1d3.slice/crio-f057aa22a39afbedf0ba62046dd45d9a506182807fe97417115914bcce9996f1 WatchSource:0}: Error finding container f057aa22a39afbedf0ba62046dd45d9a506182807fe97417115914bcce9996f1: Status 404 returned error can't find the container with id f057aa22a39afbedf0ba62046dd45d9a506182807fe97417115914bcce9996f1
Jul 11 01:39:43.307071 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:43.307049    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:39:44.197388 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:44.197347    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz" event={"ID":"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3","Type":"ContainerStarted","Data":"f057aa22a39afbedf0ba62046dd45d9a506182807fe97417115914bcce9996f1"}
Jul 11 01:39:46.212903 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:46.212865    2555 generic.go:356] "Generic (PLEG): container finished" podID="b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3" containerID="521ed4972a84709e8b91435f822e5038ab86974a03100b1b38b582f0ed015bc0" exitCode=0
Jul 11 01:39:46.213295 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:46.212948    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz" event={"ID":"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3","Type":"ContainerDied","Data":"521ed4972a84709e8b91435f822e5038ab86974a03100b1b38b582f0ed015bc0"}
Jul 11 01:39:47.356925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:47.356902    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:47.519809 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:47.519717    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3-maas-api-service-ca\") pod \"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3\" (UID: \"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3\") "
Jul 11 01:39:47.520080 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:47.520056    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3" (UID: "b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:39:47.620652 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:47.620621    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3-maas-api-service-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:39:48.224726 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:48.224698    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz"
Jul 11 01:39:48.224906 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:48.224744    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz" event={"ID":"b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3","Type":"ContainerDied","Data":"f057aa22a39afbedf0ba62046dd45d9a506182807fe97417115914bcce9996f1"}
Jul 11 01:39:48.224906 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:39:48.224798    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f057aa22a39afbedf0ba62046dd45d9a506182807fe97417115914bcce9996f1"
Jul 11 01:41:17.885464 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:41:17.885436    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:41:17.897050 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:41:17.897026    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:43:28.328905 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.328857    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"]
Jul 11 01:43:28.329556 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.329536    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3" containerName="revoke-keys"
Jul 11 01:43:28.329611 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.329559    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3" containerName="revoke-keys"
Jul 11 01:43:28.329681 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.329665    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3" containerName="revoke-keys"
Jul 11 01:43:28.333318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.333290    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:28.335765 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.335740    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:43:28.337472 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.337445    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"]
Jul 11 01:43:28.414264 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.414234    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17a0fee9-3c47-40b4-8f9f-71de203398fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m\" (UID: \"17a0fee9-3c47-40b4-8f9f-71de203398fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:28.515414 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.515376    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17a0fee9-3c47-40b4-8f9f-71de203398fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m\" (UID: \"17a0fee9-3c47-40b4-8f9f-71de203398fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:28.516002 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.515984    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17a0fee9-3c47-40b4-8f9f-71de203398fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m\" (UID: \"17a0fee9-3c47-40b4-8f9f-71de203398fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:28.647649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.647568    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:28.795592 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:28.795564    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"]
Jul 11 01:43:28.798511 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:43:28.798482    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a0fee9_3c47_40b4_8f9f_71de203398fd.slice/crio-8ffcdff726b5f58caa3a5fb2e5d70a9acff777484625c7f174c8a22cd2d00c63 WatchSource:0}: Error finding container 8ffcdff726b5f58caa3a5fb2e5d70a9acff777484625c7f174c8a22cd2d00c63: Status 404 returned error can't find the container with id 8ffcdff726b5f58caa3a5fb2e5d70a9acff777484625c7f174c8a22cd2d00c63
Jul 11 01:43:29.507167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:29.507132    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m" event={"ID":"17a0fee9-3c47-40b4-8f9f-71de203398fd","Type":"ContainerStarted","Data":"d87f6316aee3a0f5c7cb5071d21bdb6b6d1633fc5f1f32e20648817120f5f772"}
Jul 11 01:43:29.507633 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:29.507229    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m" event={"ID":"17a0fee9-3c47-40b4-8f9f-71de203398fd","Type":"ContainerStarted","Data":"8ffcdff726b5f58caa3a5fb2e5d70a9acff777484625c7f174c8a22cd2d00c63"}
Jul 11 01:43:29.526566 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:29.526506    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m" podStartSLOduration=1.526487059 podStartE2EDuration="1.526487059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:43:29.522156826 +0000 UTC m=+2232.389125379" watchObservedRunningTime="2026-07-11 01:43:29.526487059 +0000 UTC m=+2232.393455610"
Jul 11 01:43:30.514723 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:30.514682    2555 generic.go:356] "Generic (PLEG): container finished" podID="17a0fee9-3c47-40b4-8f9f-71de203398fd" containerID="d87f6316aee3a0f5c7cb5071d21bdb6b6d1633fc5f1f32e20648817120f5f772" exitCode=0
Jul 11 01:43:30.515185 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:30.514774    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m" event={"ID":"17a0fee9-3c47-40b4-8f9f-71de203398fd","Type":"ContainerDied","Data":"d87f6316aee3a0f5c7cb5071d21bdb6b6d1633fc5f1f32e20648817120f5f772"}
Jul 11 01:43:31.658502 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:31.658478    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:31.747397 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:31.747363    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17a0fee9-3c47-40b4-8f9f-71de203398fd-maas-api-service-ca\") pod \"17a0fee9-3c47-40b4-8f9f-71de203398fd\" (UID: \"17a0fee9-3c47-40b4-8f9f-71de203398fd\") "
Jul 11 01:43:31.747748 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:31.747725    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a0fee9-3c47-40b4-8f9f-71de203398fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "17a0fee9-3c47-40b4-8f9f-71de203398fd" (UID: "17a0fee9-3c47-40b4-8f9f-71de203398fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:43:31.848582 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:31.848551    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17a0fee9-3c47-40b4-8f9f-71de203398fd-maas-api-service-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:43:32.526935 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:32.526905    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m"
Jul 11 01:43:32.527103 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:32.526934    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m" event={"ID":"17a0fee9-3c47-40b4-8f9f-71de203398fd","Type":"ContainerDied","Data":"8ffcdff726b5f58caa3a5fb2e5d70a9acff777484625c7f174c8a22cd2d00c63"}
Jul 11 01:43:32.527103 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:43:32.526987    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ffcdff726b5f58caa3a5fb2e5d70a9acff777484625c7f174c8a22cd2d00c63"
Jul 11 01:44:49.374230 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.374181    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"]
Jul 11 01:44:49.374711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.374632    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a0fee9-3c47-40b4-8f9f-71de203398fd" containerName="revoke-keys"
Jul 11 01:44:49.374711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.374645    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a0fee9-3c47-40b4-8f9f-71de203398fd" containerName="revoke-keys"
Jul 11 01:44:49.374800 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.374724    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="17a0fee9-3c47-40b4-8f9f-71de203398fd" containerName="revoke-keys"
Jul 11 01:44:49.378400 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.378383    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:49.381864 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.381836    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:44:49.386187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.386162    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"]
Jul 11 01:44:49.459640 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.459598    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9237df-1f6a-49b5-af58-b0d606a1c128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx\" (UID: \"ae9237df-1f6a-49b5-af58-b0d606a1c128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:49.560245 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.560192    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9237df-1f6a-49b5-af58-b0d606a1c128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx\" (UID: \"ae9237df-1f6a-49b5-af58-b0d606a1c128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:49.561048 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.561020    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9237df-1f6a-49b5-af58-b0d606a1c128-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx\" (UID: \"ae9237df-1f6a-49b5-af58-b0d606a1c128\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:49.690663 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.690576    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:49.833889 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.833852    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"]
Jul 11 01:44:49.835905 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:44:49.835880    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9237df_1f6a_49b5_af58_b0d606a1c128.slice/crio-0d9850fe23b79938c34bd32902c9ef24d33a9b72b6be9fc1c0eda70fb6051dbd WatchSource:0}: Error finding container 0d9850fe23b79938c34bd32902c9ef24d33a9b72b6be9fc1c0eda70fb6051dbd: Status 404 returned error can't find the container with id 0d9850fe23b79938c34bd32902c9ef24d33a9b72b6be9fc1c0eda70fb6051dbd
Jul 11 01:44:49.981837 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:49.981754    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx" event={"ID":"ae9237df-1f6a-49b5-af58-b0d606a1c128","Type":"ContainerStarted","Data":"0d9850fe23b79938c34bd32902c9ef24d33a9b72b6be9fc1c0eda70fb6051dbd"}
Jul 11 01:44:50.988853 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:50.988770    2555 generic.go:356] "Generic (PLEG): container finished" podID="ae9237df-1f6a-49b5-af58-b0d606a1c128" containerID="9fec2a73bed80db95845ce6d152515cdfd1e619492aa67e998dc472136045e53" exitCode=0
Jul 11 01:44:50.988853 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:50.988834    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx" event={"ID":"ae9237df-1f6a-49b5-af58-b0d606a1c128","Type":"ContainerDied","Data":"9fec2a73bed80db95845ce6d152515cdfd1e619492aa67e998dc472136045e53"}
Jul 11 01:44:52.137289 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:52.137264    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:52.176194 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:52.176155    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9237df-1f6a-49b5-af58-b0d606a1c128-maas-api-service-ca\") pod \"ae9237df-1f6a-49b5-af58-b0d606a1c128\" (UID: \"ae9237df-1f6a-49b5-af58-b0d606a1c128\") "
Jul 11 01:44:52.176506 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:52.176484    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9237df-1f6a-49b5-af58-b0d606a1c128-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae9237df-1f6a-49b5-af58-b0d606a1c128" (UID: "ae9237df-1f6a-49b5-af58-b0d606a1c128"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:44:52.277678 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:52.277597    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae9237df-1f6a-49b5-af58-b0d606a1c128-maas-api-service-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:44:53.001520 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:53.001428    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx"
Jul 11 01:44:53.001520 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:53.001460    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx" event={"ID":"ae9237df-1f6a-49b5-af58-b0d606a1c128","Type":"ContainerDied","Data":"0d9850fe23b79938c34bd32902c9ef24d33a9b72b6be9fc1c0eda70fb6051dbd"}
Jul 11 01:44:53.001726 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:44:53.001521    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d9850fe23b79938c34bd32902c9ef24d33a9b72b6be9fc1c0eda70fb6051dbd"
Jul 11 01:45:00.127736 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.127700    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"]
Jul 11 01:45:00.128273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.128128    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9237df-1f6a-49b5-af58-b0d606a1c128" containerName="revoke-keys"
Jul 11 01:45:00.128273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.128138    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9237df-1f6a-49b5-af58-b0d606a1c128" containerName="revoke-keys"
Jul 11 01:45:00.128273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.128215    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9237df-1f6a-49b5-af58-b0d606a1c128" containerName="revoke-keys"
Jul 11 01:45:00.131416 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.131393    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"
Jul 11 01:45:00.133815 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.133787    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:45:00.141020 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.140984    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"]
Jul 11 01:45:00.151048 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.151020    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"
Jul 11 01:45:00.292533 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:00.292505    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"]
Jul 11 01:45:00.294354 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:45:00.294322    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499d4caa_ba4b_4788_8207_0ae7a21fc5f3.slice/crio-8059b10b64dae952552297de87e91feffc100af95a35e2d6528ab8ad37e53981 WatchSource:0}: Error finding container 8059b10b64dae952552297de87e91feffc100af95a35e2d6528ab8ad37e53981: Status 404 returned error can't find the container with id 8059b10b64dae952552297de87e91feffc100af95a35e2d6528ab8ad37e53981
Jul 11 01:45:01.048211 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:01.048161    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp" event={"ID":"499d4caa-ba4b-4788-8207-0ae7a21fc5f3","Type":"ContainerStarted","Data":"575ba2f9a9fa885b8f19f9851eb170750c68e3dbf19ec7ca28825b891c43d06f"}
Jul 11 01:45:01.048418 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:01.048299    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp" event={"ID":"499d4caa-ba4b-4788-8207-0ae7a21fc5f3","Type":"ContainerStarted","Data":"8059b10b64dae952552297de87e91feffc100af95a35e2d6528ab8ad37e53981"}
Jul 11 01:45:01.064480 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:01.064420    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp" podStartSLOduration=1.064401942 podStartE2EDuration="1.064401942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:45:01.061725826 +0000 UTC m=+2323.928694378" watchObservedRunningTime="2026-07-11 01:45:01.064401942 +0000 UTC m=+2323.931370492"
Jul 11 01:45:02.055284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:02.055247    2555 generic.go:356] "Generic (PLEG): container finished" podID="499d4caa-ba4b-4788-8207-0ae7a21fc5f3" containerID="575ba2f9a9fa885b8f19f9851eb170750c68e3dbf19ec7ca28825b891c43d06f" exitCode=0
Jul 11 01:45:02.055682 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:02.055304    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp" event={"ID":"499d4caa-ba4b-4788-8207-0ae7a21fc5f3","Type":"ContainerDied","Data":"575ba2f9a9fa885b8f19f9851eb170750c68e3dbf19ec7ca28825b891c43d06f"}
Jul 11 01:45:03.217125 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:03.217093    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"
Jul 11 01:45:04.068568 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:04.068530    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp" event={"ID":"499d4caa-ba4b-4788-8207-0ae7a21fc5f3","Type":"ContainerDied","Data":"8059b10b64dae952552297de87e91feffc100af95a35e2d6528ab8ad37e53981"}
Jul 11 01:45:04.068749 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:04.068579    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8059b10b64dae952552297de87e91feffc100af95a35e2d6528ab8ad37e53981"
Jul 11 01:45:04.068749 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:45:04.068544    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728905-tz2fp"
Jul 11 01:46:17.927771 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:46:17.927738    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:46:17.946057 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:46:17.946035    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:47:55.213843 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.213807    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"]
Jul 11 01:47:55.214503 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.214482    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="499d4caa-ba4b-4788-8207-0ae7a21fc5f3" containerName="cleanup"
Jul 11 01:47:55.214591 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.214506    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="499d4caa-ba4b-4788-8207-0ae7a21fc5f3" containerName="cleanup"
Jul 11 01:47:55.214659 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.214618    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="499d4caa-ba4b-4788-8207-0ae7a21fc5f3" containerName="cleanup"
Jul 11 01:47:55.217586 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.217561    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.220816 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.220777    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1e79cd\"/\"kube-root-ca.crt\""
Jul 11 01:47:55.220989 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.220787    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1e79cd\"/\"openshift-service-ca.crt\""
Jul 11 01:47:55.222027 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.222006    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1e79cd\"/\"test-model-1e79cd-kserve-self-signed-certs\""
Jul 11 01:47:55.222154 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.222132    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1e79cd\"/\"default-dockercfg-kqmzf\""
Jul 11 01:47:55.227963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.227938    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"]
Jul 11 01:47:55.307587 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.307553    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-home\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.307750 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.307602    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-tmp-dir\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.307750 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.307625    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-dshm\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.307750 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.307652    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-model-cache\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.307750 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.307722    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzz58\" (UniqueName: \"kubernetes.io/projected/4334c9a1-24c4-40b3-884a-4c5c459d5638-kube-api-access-qzz58\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.307897 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.307829    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4334c9a1-24c4-40b3-884a-4c5c459d5638-tls-certs\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.408481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408448    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-tmp-dir\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.408481 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408483    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-dshm\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.408716 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408513    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-model-cache\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.408716 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408543    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzz58\" (UniqueName: \"kubernetes.io/projected/4334c9a1-24c4-40b3-884a-4c5c459d5638-kube-api-access-qzz58\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.408716 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408633    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4334c9a1-24c4-40b3-884a-4c5c459d5638-tls-certs\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.408716 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408711    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-home\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.409024 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.408998    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-tmp-dir\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.409117 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.409026    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-model-cache\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.409117 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.409053    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-home\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.410718 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.410694    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-dshm\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.411042 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.411025    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4334c9a1-24c4-40b3-884a-4c5c459d5638-tls-certs\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.416436 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.416415    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzz58\" (UniqueName: \"kubernetes.io/projected/4334c9a1-24c4-40b3-884a-4c5c459d5638-kube-api-access-qzz58\") pod \"test-model-1e79cd-kserve-6dfdf96d59-b7lz7\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") " pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.529652 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.529615    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:47:55.666142 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:55.665965    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"]
Jul 11 01:47:55.668740 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:47:55.668712    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4334c9a1_24c4_40b3_884a_4c5c459d5638.slice/crio-1b765b27d6086224ff53ae34cb72e3fc87c66b7004d5e18c1a58229dbe3643ea WatchSource:0}: Error finding container 1b765b27d6086224ff53ae34cb72e3fc87c66b7004d5e18c1a58229dbe3643ea: Status 404 returned error can't find the container with id 1b765b27d6086224ff53ae34cb72e3fc87c66b7004d5e18c1a58229dbe3643ea
Jul 11 01:47:56.111378 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:56.111339    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7" event={"ID":"4334c9a1-24c4-40b3-884a-4c5c459d5638","Type":"ContainerStarted","Data":"7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f"}
Jul 11 01:47:56.111378 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:56.111384    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7" event={"ID":"4334c9a1-24c4-40b3-884a-4c5c459d5638","Type":"ContainerStarted","Data":"1b765b27d6086224ff53ae34cb72e3fc87c66b7004d5e18c1a58229dbe3643ea"}
Jul 11 01:47:56.129427 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:47:56.129371    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7" podStartSLOduration=1.129356101 podStartE2EDuration="1.129356101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:47:56.127306012 +0000 UTC m=+2498.994274562" watchObservedRunningTime="2026-07-11 01:47:56.129356101 +0000 UTC m=+2498.996324651"
Jul 11 01:48:05.530256 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:05.530169    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:48:05.530764 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:05.530279    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:48:05.543005 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:05.542977    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:48:06.188178 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:06.188142    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:48:18.729979 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:18.729876    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"]
Jul 11 01:48:33.751551 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:33.751510    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7" podUID="4334c9a1-24c4-40b3-884a-4c5c459d5638" containerName="main" containerID="cri-o://7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f" gracePeriod=45
Jul 11 01:48:34.015238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.015156    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:48:34.070483 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070447    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzz58\" (UniqueName: \"kubernetes.io/projected/4334c9a1-24c4-40b3-884a-4c5c459d5638-kube-api-access-qzz58\") pod \"4334c9a1-24c4-40b3-884a-4c5c459d5638\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") "
Jul 11 01:48:34.070649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070496    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-model-cache\") pod \"4334c9a1-24c4-40b3-884a-4c5c459d5638\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") "
Jul 11 01:48:34.070649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070544    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4334c9a1-24c4-40b3-884a-4c5c459d5638-tls-certs\") pod \"4334c9a1-24c4-40b3-884a-4c5c459d5638\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") "
Jul 11 01:48:34.070649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070619    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-home\") pod \"4334c9a1-24c4-40b3-884a-4c5c459d5638\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") "
Jul 11 01:48:34.070810 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070692    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-dshm\") pod \"4334c9a1-24c4-40b3-884a-4c5c459d5638\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") "
Jul 11 01:48:34.070810 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070722    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-tmp-dir\") pod \"4334c9a1-24c4-40b3-884a-4c5c459d5638\" (UID: \"4334c9a1-24c4-40b3-884a-4c5c459d5638\") "
Jul 11 01:48:34.070967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070829    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-model-cache" (OuterVolumeSpecName: "model-cache") pod "4334c9a1-24c4-40b3-884a-4c5c459d5638" (UID: "4334c9a1-24c4-40b3-884a-4c5c459d5638"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:34.070967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.070935    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-home" (OuterVolumeSpecName: "home") pod "4334c9a1-24c4-40b3-884a-4c5c459d5638" (UID: "4334c9a1-24c4-40b3-884a-4c5c459d5638"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:34.071083 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.071059    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4334c9a1-24c4-40b3-884a-4c5c459d5638" (UID: "4334c9a1-24c4-40b3-884a-4c5c459d5638"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:34.071138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.071095    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-model-cache\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:34.071138 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.071115    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-home\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:34.072848 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.072817    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4334c9a1-24c4-40b3-884a-4c5c459d5638-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4334c9a1-24c4-40b3-884a-4c5c459d5638" (UID: "4334c9a1-24c4-40b3-884a-4c5c459d5638"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:48:34.072848 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.072835    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4334c9a1-24c4-40b3-884a-4c5c459d5638-kube-api-access-qzz58" (OuterVolumeSpecName: "kube-api-access-qzz58") pod "4334c9a1-24c4-40b3-884a-4c5c459d5638" (UID: "4334c9a1-24c4-40b3-884a-4c5c459d5638"). InnerVolumeSpecName "kube-api-access-qzz58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:48:34.073011 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.072813    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-dshm" (OuterVolumeSpecName: "dshm") pod "4334c9a1-24c4-40b3-884a-4c5c459d5638" (UID: "4334c9a1-24c4-40b3-884a-4c5c459d5638"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:48:34.171729 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.171694    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4334c9a1-24c4-40b3-884a-4c5c459d5638-tls-certs\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:34.171729 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.171722    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-dshm\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:34.171729 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.171731    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4334c9a1-24c4-40b3-884a-4c5c459d5638-tmp-dir\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:34.171729 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.171740    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzz58\" (UniqueName: \"kubernetes.io/projected/4334c9a1-24c4-40b3-884a-4c5c459d5638-kube-api-access-qzz58\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:34.348144 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.348106    2555 generic.go:356] "Generic (PLEG): container finished" podID="4334c9a1-24c4-40b3-884a-4c5c459d5638" containerID="7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f" exitCode=0
Jul 11 01:48:34.348347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.348150    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"
Jul 11 01:48:34.348347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.348190    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7" event={"ID":"4334c9a1-24c4-40b3-884a-4c5c459d5638","Type":"ContainerDied","Data":"7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f"}
Jul 11 01:48:34.348347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.348260    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7" event={"ID":"4334c9a1-24c4-40b3-884a-4c5c459d5638","Type":"ContainerDied","Data":"1b765b27d6086224ff53ae34cb72e3fc87c66b7004d5e18c1a58229dbe3643ea"}
Jul 11 01:48:34.348347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.348281    2555 scope.go:117] "RemoveContainer" containerID="7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f"
Jul 11 01:48:34.358443 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.358421    2555 scope.go:117] "RemoveContainer" containerID="7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f"
Jul 11 01:48:34.358746 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:48:34.358722    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f\": container with ID starting with 7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f not found: ID does not exist" containerID="7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f"
Jul 11 01:48:34.358833 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.358754    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f"} err="failed to get container status \"7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f\": rpc error: code = NotFound desc = could not find container \"7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f\": container with ID starting with 7035f00fc0630582318ed91f23e8622872991dc3df8438106421e72f2dc1b37f not found: ID does not exist"
Jul 11 01:48:34.369842 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.369812    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"]
Jul 11 01:48:34.384002 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.383971    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1e79cd/test-model-1e79cd-kserve-6dfdf96d59-b7lz7"]
Jul 11 01:48:34.700064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:34.699980    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4334c9a1-24c4-40b3-884a-4c5c459d5638" path="/var/lib/kubelet/pods/4334c9a1-24c4-40b3-884a-4c5c459d5638/volumes"
Jul 11 01:48:44.903718 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.903685    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"]
Jul 11 01:48:44.904181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.904126    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4334c9a1-24c4-40b3-884a-4c5c459d5638" containerName="main"
Jul 11 01:48:44.904181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.904136    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4334c9a1-24c4-40b3-884a-4c5c459d5638" containerName="main"
Jul 11 01:48:44.904282 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.904223    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4334c9a1-24c4-40b3-884a-4c5c459d5638" containerName="main"
Jul 11 01:48:44.908782 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.908764    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:44.911562 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.911512    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:48:44.914246 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.914197    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"]
Jul 11 01:48:44.975631 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:44.975588    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cf71943-d319-4d9c-9e52-794ab3f12b49-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx\" (UID: \"1cf71943-d319-4d9c-9e52-794ab3f12b49\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:45.076579 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:45.076545    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cf71943-d319-4d9c-9e52-794ab3f12b49-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx\" (UID: \"1cf71943-d319-4d9c-9e52-794ab3f12b49\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:45.077169 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:45.077149    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cf71943-d319-4d9c-9e52-794ab3f12b49-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx\" (UID: \"1cf71943-d319-4d9c-9e52-794ab3f12b49\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:45.221372 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:45.221286    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:45.364837 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:45.364689    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"]
Jul 11 01:48:45.366503 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:48:45.366476    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf71943_d319_4d9c_9e52_794ab3f12b49.slice/crio-f5ea3ed096d6b1a469e6f816215921492d4738cd2ee4e218069557b8284e9fb3 WatchSource:0}: Error finding container f5ea3ed096d6b1a469e6f816215921492d4738cd2ee4e218069557b8284e9fb3: Status 404 returned error can't find the container with id f5ea3ed096d6b1a469e6f816215921492d4738cd2ee4e218069557b8284e9fb3
Jul 11 01:48:45.416595 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:45.416560    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx" event={"ID":"1cf71943-d319-4d9c-9e52-794ab3f12b49","Type":"ContainerStarted","Data":"f5ea3ed096d6b1a469e6f816215921492d4738cd2ee4e218069557b8284e9fb3"}
Jul 11 01:48:46.424028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:46.423942    2555 generic.go:356] "Generic (PLEG): container finished" podID="1cf71943-d319-4d9c-9e52-794ab3f12b49" containerID="20602de6ddfa91d654516e4c6fb8ed8262fe7c7d642d2ac57a9999ade4f405d1" exitCode=0
Jul 11 01:48:46.424028 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:46.423997    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx" event={"ID":"1cf71943-d319-4d9c-9e52-794ab3f12b49","Type":"ContainerDied","Data":"20602de6ddfa91d654516e4c6fb8ed8262fe7c7d642d2ac57a9999ade4f405d1"}
Jul 11 01:48:47.578189 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:47.578158    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:47.703311 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:47.703187    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cf71943-d319-4d9c-9e52-794ab3f12b49-maas-api-service-ca\") pod \"1cf71943-d319-4d9c-9e52-794ab3f12b49\" (UID: \"1cf71943-d319-4d9c-9e52-794ab3f12b49\") "
Jul 11 01:48:47.703603 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:47.703574    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf71943-d319-4d9c-9e52-794ab3f12b49-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1cf71943-d319-4d9c-9e52-794ab3f12b49" (UID: "1cf71943-d319-4d9c-9e52-794ab3f12b49"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:48:47.804044 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:47.804002    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cf71943-d319-4d9c-9e52-794ab3f12b49-maas-api-service-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:48:48.436221 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:48.436184    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx"
Jul 11 01:48:48.436405 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:48.436182    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx" event={"ID":"1cf71943-d319-4d9c-9e52-794ab3f12b49","Type":"ContainerDied","Data":"f5ea3ed096d6b1a469e6f816215921492d4738cd2ee4e218069557b8284e9fb3"}
Jul 11 01:48:48.436405 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:48:48.436338    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5ea3ed096d6b1a469e6f816215921492d4738cd2ee4e218069557b8284e9fb3"
Jul 11 01:50:00.984284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.980746    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"]
Jul 11 01:50:00.984284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.981700    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf71943-d319-4d9c-9e52-794ab3f12b49" containerName="revoke-keys"
Jul 11 01:50:00.984284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.981723    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf71943-d319-4d9c-9e52-794ab3f12b49" containerName="revoke-keys"
Jul 11 01:50:00.984284 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.981947    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf71943-d319-4d9c-9e52-794ab3f12b49" containerName="revoke-keys"
Jul 11 01:50:00.986549 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.986523    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:00.989452 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.989425    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:50:00.990898 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:00.990869    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"]
Jul 11 01:50:01.086925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:01.086888    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d117e091-a38e-41fe-85c1-8db849b1bb46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-124c39-gxvm6\" (UID: \"d117e091-a38e-41fe-85c1-8db849b1bb46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:01.188106 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:01.188061    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d117e091-a38e-41fe-85c1-8db849b1bb46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-124c39-gxvm6\" (UID: \"d117e091-a38e-41fe-85c1-8db849b1bb46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:01.188755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:01.188733    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d117e091-a38e-41fe-85c1-8db849b1bb46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-124c39-gxvm6\" (UID: \"d117e091-a38e-41fe-85c1-8db849b1bb46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:01.299299 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:01.299253    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:01.652236 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:01.652170    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"]
Jul 11 01:50:01.653855 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:50:01.653829    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd117e091_a38e_41fe_85c1_8db849b1bb46.slice/crio-32faf5b8541c249f40947d7ab2aa8e431252436a52f6bee44e892f165ba85036 WatchSource:0}: Error finding container 32faf5b8541c249f40947d7ab2aa8e431252436a52f6bee44e892f165ba85036: Status 404 returned error can't find the container with id 32faf5b8541c249f40947d7ab2aa8e431252436a52f6bee44e892f165ba85036
Jul 11 01:50:01.882077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:01.882029    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6" event={"ID":"d117e091-a38e-41fe-85c1-8db849b1bb46","Type":"ContainerStarted","Data":"32faf5b8541c249f40947d7ab2aa8e431252436a52f6bee44e892f165ba85036"}
Jul 11 01:50:02.889154 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:02.889116    2555 generic.go:356] "Generic (PLEG): container finished" podID="d117e091-a38e-41fe-85c1-8db849b1bb46" containerID="96205b493a050d490b957c810d4b51170f1abcbf06811a00a33cc91b1973c22f" exitCode=0
Jul 11 01:50:02.889584 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:02.889216    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6" event={"ID":"d117e091-a38e-41fe-85c1-8db849b1bb46","Type":"ContainerDied","Data":"96205b493a050d490b957c810d4b51170f1abcbf06811a00a33cc91b1973c22f"}
Jul 11 01:50:04.040478 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.040450    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:04.118030 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.117993    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d117e091-a38e-41fe-85c1-8db849b1bb46-maas-api-service-ca\") pod \"d117e091-a38e-41fe-85c1-8db849b1bb46\" (UID: \"d117e091-a38e-41fe-85c1-8db849b1bb46\") "
Jul 11 01:50:04.118420 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.118397    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d117e091-a38e-41fe-85c1-8db849b1bb46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d117e091-a38e-41fe-85c1-8db849b1bb46" (UID: "d117e091-a38e-41fe-85c1-8db849b1bb46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:50:04.219117 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.219021    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d117e091-a38e-41fe-85c1-8db849b1bb46-maas-api-service-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:50:04.902913 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.902883    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6"
Jul 11 01:50:04.903110 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.902930    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-124c39-gxvm6" event={"ID":"d117e091-a38e-41fe-85c1-8db849b1bb46","Type":"ContainerDied","Data":"32faf5b8541c249f40947d7ab2aa8e431252436a52f6bee44e892f165ba85036"}
Jul 11 01:50:04.903110 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:50:04.902984    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32faf5b8541c249f40947d7ab2aa8e431252436a52f6bee44e892f165ba85036"
Jul 11 01:51:06.004542 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.004501    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"]
Jul 11 01:51:06.005197 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.005175    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d117e091-a38e-41fe-85c1-8db849b1bb46" containerName="revoke-keys"
Jul 11 01:51:06.005275 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.005218    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d117e091-a38e-41fe-85c1-8db849b1bb46" containerName="revoke-keys"
Jul 11 01:51:06.005381 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.005367    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d117e091-a38e-41fe-85c1-8db849b1bb46" containerName="revoke-keys"
Jul 11 01:51:06.009169 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.009145    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.012955 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.012928    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-696ed9\"/\"openshift-service-ca.crt\""
Jul 11 01:51:06.013140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.012989    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-696ed9\"/\"default-dockercfg-t2t96\""
Jul 11 01:51:06.013140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.012936    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-696ed9\"/\"auth-test-model-696ed9-kserve-self-signed-certs\""
Jul 11 01:51:06.013140 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.013039    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-696ed9\"/\"kube-root-ca.crt\""
Jul 11 01:51:06.018043 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.017654    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"]
Jul 11 01:51:06.078022 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.077985    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bkdl\" (UniqueName: \"kubernetes.io/projected/244572f6-36e6-478d-8d8f-d230405ed31c-kube-api-access-5bkdl\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.078022 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.078025    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-home\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.078269 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.078047    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-dshm\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.078269 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.078136    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-model-cache\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.078269 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.078161    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-tmp-dir\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.078269 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.078223    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/244572f6-36e6-478d-8d8f-d230405ed31c-tls-certs\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.178846 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.178810    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/244572f6-36e6-478d-8d8f-d230405ed31c-tls-certs\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.178865    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bkdl\" (UniqueName: \"kubernetes.io/projected/244572f6-36e6-478d-8d8f-d230405ed31c-kube-api-access-5bkdl\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.178901    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-home\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.178929    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-dshm\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.179001    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-model-cache\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.179026    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-tmp-dir\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179440 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.179403    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-home\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179556 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.179413    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-model-cache\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.179556 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.179486    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-tmp-dir\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.181236 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.181188    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-dshm\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.181369 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.181350    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/244572f6-36e6-478d-8d8f-d230405ed31c-tls-certs\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.186553 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.186525    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bkdl\" (UniqueName: \"kubernetes.io/projected/244572f6-36e6-478d-8d8f-d230405ed31c-kube-api-access-5bkdl\") pod \"auth-test-model-696ed9-kserve-555dc78fc9-plgqb\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") " pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.322020 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.321977    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:06.472645 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:06.472616    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"]
Jul 11 01:51:06.473598 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:51:06.473570    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod244572f6_36e6_478d_8d8f_d230405ed31c.slice/crio-f67e7e5bc0543ccc55cdcde03c304b4de4034e3e21496e078b6c1e32a7bb3445 WatchSource:0}: Error finding container f67e7e5bc0543ccc55cdcde03c304b4de4034e3e21496e078b6c1e32a7bb3445: Status 404 returned error can't find the container with id f67e7e5bc0543ccc55cdcde03c304b4de4034e3e21496e078b6c1e32a7bb3445
Jul 11 01:51:07.288470 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:07.288429    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb" event={"ID":"244572f6-36e6-478d-8d8f-d230405ed31c","Type":"ContainerStarted","Data":"dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a"}
Jul 11 01:51:07.288876 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:07.288478    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb" event={"ID":"244572f6-36e6-478d-8d8f-d230405ed31c","Type":"ContainerStarted","Data":"f67e7e5bc0543ccc55cdcde03c304b4de4034e3e21496e078b6c1e32a7bb3445"}
Jul 11 01:51:07.307337 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:07.307286    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb" podStartSLOduration=2.307269392 podStartE2EDuration="2.307269392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:51:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:51:07.304766083 +0000 UTC m=+2690.171734634" watchObservedRunningTime="2026-07-11 01:51:07.307269392 +0000 UTC m=+2690.174237941"
Jul 11 01:51:16.322586 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:16.322536    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:16.323100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:16.322605    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:16.335692 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:16.335658    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:16.356635 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:16.356599    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:51:17.971789 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:17.971668    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:51:17.990119 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:51:17.990092    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:53:39.595187 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:39.595153    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"]
Jul 11 01:53:52.899527 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:52.899486    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"]
Jul 11 01:53:52.903404 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:52.903385    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:52.905796 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:52.905779    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-696ed9\"/\"sub-test-model-696ed9-kserve-self-signed-certs\""
Jul 11 01:53:52.915807 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:52.915781    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"]
Jul 11 01:53:53.032064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.032027    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgppw\" (UniqueName: \"kubernetes.io/projected/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-kube-api-access-tgppw\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.032259 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.032092    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tmp-dir\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.032259 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.032116    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tls-certs\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.032259 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.032139    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-home\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.032259 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.032162    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-dshm\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.032425 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.032261    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-model-cache\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133437 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133401    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-dshm\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133447    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-model-cache\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133499    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgppw\" (UniqueName: \"kubernetes.io/projected/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-kube-api-access-tgppw\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133649 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133546    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tmp-dir\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133826 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133677    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tls-certs\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133826 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133716    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-home\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133939 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133925    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-model-cache\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.133993 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.133973    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tmp-dir\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.134041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.134021    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-home\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.135805 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.135781    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-dshm\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.136042 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.136024    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tls-certs\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.141925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.141902    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgppw\" (UniqueName: \"kubernetes.io/projected/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-kube-api-access-tgppw\") pod \"sub-test-model-696ed9-kserve-f988dd4f-tqzx6\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") " pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.212996 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.212923    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:53:53.360512 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:53.360478    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"]
Jul 11 01:53:53.361717 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:53:53.361679    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ffedc90_e5f5_4cc6_a79d_6c295e096f7d.slice/crio-b7f9a13717a9640c32706359e9e1b17447e639d14efa702c94569250da715c2b WatchSource:0}: Error finding container b7f9a13717a9640c32706359e9e1b17447e639d14efa702c94569250da715c2b: Status 404 returned error can't find the container with id b7f9a13717a9640c32706359e9e1b17447e639d14efa702c94569250da715c2b
Jul 11 01:53:54.319724 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:54.319681    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6" event={"ID":"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d","Type":"ContainerStarted","Data":"af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11"}
Jul 11 01:53:54.319724 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:54.319737    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6" event={"ID":"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d","Type":"ContainerStarted","Data":"b7f9a13717a9640c32706359e9e1b17447e639d14efa702c94569250da715c2b"}
Jul 11 01:53:54.341852 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:54.341783    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6" podStartSLOduration=2.341762594 podStartE2EDuration="2.341762594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:53:54.33446698 +0000 UTC m=+2857.201435530" watchObservedRunningTime="2026-07-11 01:53:54.341762594 +0000 UTC m=+2857.208731145"
Jul 11 01:53:54.615343 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:54.615252    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb" podUID="244572f6-36e6-478d-8d8f-d230405ed31c" containerName="main" containerID="cri-o://dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a" gracePeriod=45
Jul 11 01:53:54.883598 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:54.883571    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:53:55.051964 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.051933    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-tmp-dir\") pod \"244572f6-36e6-478d-8d8f-d230405ed31c\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") "
Jul 11 01:53:55.052177 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052007    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/244572f6-36e6-478d-8d8f-d230405ed31c-tls-certs\") pod \"244572f6-36e6-478d-8d8f-d230405ed31c\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") "
Jul 11 01:53:55.052177 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052077    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bkdl\" (UniqueName: \"kubernetes.io/projected/244572f6-36e6-478d-8d8f-d230405ed31c-kube-api-access-5bkdl\") pod \"244572f6-36e6-478d-8d8f-d230405ed31c\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") "
Jul 11 01:53:55.052177 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052100    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-dshm\") pod \"244572f6-36e6-478d-8d8f-d230405ed31c\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") "
Jul 11 01:53:55.052373 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052237    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-home\") pod \"244572f6-36e6-478d-8d8f-d230405ed31c\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") "
Jul 11 01:53:55.052373 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052278    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-model-cache\") pod \"244572f6-36e6-478d-8d8f-d230405ed31c\" (UID: \"244572f6-36e6-478d-8d8f-d230405ed31c\") "
Jul 11 01:53:55.052373 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052312    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "244572f6-36e6-478d-8d8f-d230405ed31c" (UID: "244572f6-36e6-478d-8d8f-d230405ed31c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.052529 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052510    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-home" (OuterVolumeSpecName: "home") pod "244572f6-36e6-478d-8d8f-d230405ed31c" (UID: "244572f6-36e6-478d-8d8f-d230405ed31c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.052658 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052641    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-home\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.052720 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052665    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-tmp-dir\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.052805 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.052778    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-model-cache" (OuterVolumeSpecName: "model-cache") pod "244572f6-36e6-478d-8d8f-d230405ed31c" (UID: "244572f6-36e6-478d-8d8f-d230405ed31c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.054497 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.054466    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/244572f6-36e6-478d-8d8f-d230405ed31c-kube-api-access-5bkdl" (OuterVolumeSpecName: "kube-api-access-5bkdl") pod "244572f6-36e6-478d-8d8f-d230405ed31c" (UID: "244572f6-36e6-478d-8d8f-d230405ed31c"). InnerVolumeSpecName "kube-api-access-5bkdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:53:55.054659 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.054640    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/244572f6-36e6-478d-8d8f-d230405ed31c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "244572f6-36e6-478d-8d8f-d230405ed31c" (UID: "244572f6-36e6-478d-8d8f-d230405ed31c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:53:55.054736 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.054674    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-dshm" (OuterVolumeSpecName: "dshm") pod "244572f6-36e6-478d-8d8f-d230405ed31c" (UID: "244572f6-36e6-478d-8d8f-d230405ed31c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:53:55.153648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.153563    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bkdl\" (UniqueName: \"kubernetes.io/projected/244572f6-36e6-478d-8d8f-d230405ed31c-kube-api-access-5bkdl\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.153648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.153593    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-dshm\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.153648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.153606    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/244572f6-36e6-478d-8d8f-d230405ed31c-model-cache\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.153648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.153618    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/244572f6-36e6-478d-8d8f-d230405ed31c-tls-certs\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:53:55.327796 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.327763    2555 generic.go:356] "Generic (PLEG): container finished" podID="244572f6-36e6-478d-8d8f-d230405ed31c" containerID="dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a" exitCode=0
Jul 11 01:53:55.328251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.327810    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"
Jul 11 01:53:55.328251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.327854    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb" event={"ID":"244572f6-36e6-478d-8d8f-d230405ed31c","Type":"ContainerDied","Data":"dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a"}
Jul 11 01:53:55.328251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.327892    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb" event={"ID":"244572f6-36e6-478d-8d8f-d230405ed31c","Type":"ContainerDied","Data":"f67e7e5bc0543ccc55cdcde03c304b4de4034e3e21496e078b6c1e32a7bb3445"}
Jul 11 01:53:55.328251 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.327911    2555 scope.go:117] "RemoveContainer" containerID="dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a"
Jul 11 01:53:55.338021 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.338003    2555 scope.go:117] "RemoveContainer" containerID="dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a"
Jul 11 01:53:55.338320 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:53:55.338296    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a\": container with ID starting with dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a not found: ID does not exist" containerID="dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a"
Jul 11 01:53:55.338418 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.338338    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a"} err="failed to get container status \"dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a\": rpc error: code = NotFound desc = could not find container \"dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a\": container with ID starting with dff5d47a94b79e3a5ce2865d0dfa786d9cac879ec7abe402dc9508225b6a157a not found: ID does not exist"
Jul 11 01:53:55.349005 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.348983    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"]
Jul 11 01:53:55.351588 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:55.351569    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/auth-test-model-696ed9-kserve-555dc78fc9-plgqb"]
Jul 11 01:53:56.699741 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:53:56.699706    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="244572f6-36e6-478d-8d8f-d230405ed31c" path="/var/lib/kubelet/pods/244572f6-36e6-478d-8d8f-d230405ed31c/volumes"
Jul 11 01:54:03.213622 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:54:03.213582    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:54:03.214065 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:54:03.213662    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:54:03.226238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:54:03.226215    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:54:03.390521 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:54:03.390486    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:55:06.111275 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:06.111241    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"]
Jul 11 01:55:11.312577 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.312544    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"]
Jul 11 01:55:11.312959 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.312948    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="244572f6-36e6-478d-8d8f-d230405ed31c" containerName="main"
Jul 11 01:55:11.312959 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.312958    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="244572f6-36e6-478d-8d8f-d230405ed31c" containerName="main"
Jul 11 01:55:11.313047 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.313039    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="244572f6-36e6-478d-8d8f-d230405ed31c" containerName="main"
Jul 11 01:55:11.316141 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.316122    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.318745 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.318713    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-696ed9\"/\"rate-test-model-696ed9-kserve-self-signed-certs\""
Jul 11 01:55:11.325818 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.325792    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"]
Jul 11 01:55:11.445547 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.445508    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-home\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.445547 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.445553    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc014cdd-345e-4176-964a-0dd9793d5c57-tls-certs\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.445751 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.445574    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4jwk\" (UniqueName: \"kubernetes.io/projected/dc014cdd-345e-4176-964a-0dd9793d5c57-kube-api-access-z4jwk\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.445751 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.445651    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-model-cache\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.445751 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.445699    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-dshm\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.445851 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.445781    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-tmp-dir\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546327 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546296    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-model-cache\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546349    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-dshm\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546384    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-tmp-dir\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546415    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-home\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546438    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc014cdd-345e-4176-964a-0dd9793d5c57-tls-certs\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546456    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4jwk\" (UniqueName: \"kubernetes.io/projected/dc014cdd-345e-4176-964a-0dd9793d5c57-kube-api-access-z4jwk\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546796 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546752    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-model-cache\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546797    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-home\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.546957 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.546937    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-tmp-dir\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.548711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.548692    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-dshm\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.548873 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.548855    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc014cdd-345e-4176-964a-0dd9793d5c57-tls-certs\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.555018 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.554980    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4jwk\" (UniqueName: \"kubernetes.io/projected/dc014cdd-345e-4176-964a-0dd9793d5c57-kube-api-access-z4jwk\") pod \"rate-test-model-696ed9-kserve-757db584bc-vwt7b\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") " pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.626891 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.626801    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:11.786255 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.786220    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"]
Jul 11 01:55:11.787162 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:55:11.787138    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc014cdd_345e_4176_964a_0dd9793d5c57.slice/crio-fbde0bc17a3bc409b43b7196ba1fbb9edb46cd0883474cd0544957074ae92e92 WatchSource:0}: Error finding container fbde0bc17a3bc409b43b7196ba1fbb9edb46cd0883474cd0544957074ae92e92: Status 404 returned error can't find the container with id fbde0bc17a3bc409b43b7196ba1fbb9edb46cd0883474cd0544957074ae92e92
Jul 11 01:55:11.796967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:11.796942    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b" event={"ID":"dc014cdd-345e-4176-964a-0dd9793d5c57","Type":"ContainerStarted","Data":"fbde0bc17a3bc409b43b7196ba1fbb9edb46cd0883474cd0544957074ae92e92"}
Jul 11 01:55:12.804474 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:12.804435    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b" event={"ID":"dc014cdd-345e-4176-964a-0dd9793d5c57","Type":"ContainerStarted","Data":"9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5"}
Jul 11 01:55:12.823085 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:12.823031    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b" podStartSLOduration=1.8230136780000001 podStartE2EDuration="1.823013678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 01:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:55:12.820551341 +0000 UTC m=+2935.687519891" watchObservedRunningTime="2026-07-11 01:55:12.823013678 +0000 UTC m=+2935.689982228"
Jul 11 01:55:21.131438 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.131395    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6" podUID="0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" containerName="main" containerID="cri-o://af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11" gracePeriod=45
Jul 11 01:55:21.406597 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.406569    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:55:21.547723 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.547692    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tls-certs\") pod \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") "
Jul 11 01:55:21.547891 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.547779    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tmp-dir\") pod \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") "
Jul 11 01:55:21.547891 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.547824    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-dshm\") pod \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") "
Jul 11 01:55:21.547967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.547890    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgppw\" (UniqueName: \"kubernetes.io/projected/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-kube-api-access-tgppw\") pod \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") "
Jul 11 01:55:21.547967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.547925    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-home\") pod \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") "
Jul 11 01:55:21.547967 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.547949    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-model-cache\") pod \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\" (UID: \"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d\") "
Jul 11 01:55:21.548100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.548021    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" (UID: "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:21.548181 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.548158    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-home" (OuterVolumeSpecName: "home") pod "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" (UID: "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:21.548282 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.548257    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" (UID: "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:21.548340 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.548310    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-home\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:55:21.548340 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.548322    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tmp-dir\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:55:21.549995 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.549964    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" (UID: "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:55:21.550134 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.550111    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-dshm" (OuterVolumeSpecName: "dshm") pod "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" (UID: "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:55:21.550228 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.550143    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-kube-api-access-tgppw" (OuterVolumeSpecName: "kube-api-access-tgppw") pod "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" (UID: "0ffedc90-e5f5-4cc6-a79d-6c295e096f7d"). InnerVolumeSpecName "kube-api-access-tgppw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:55:21.627082 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.627044    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:21.627303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.627105    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:21.640775 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.640697    2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:21.649394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.649366    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-dshm\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:55:21.649394 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.649394    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgppw\" (UniqueName: \"kubernetes.io/projected/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-kube-api-access-tgppw\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:55:21.649559 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.649409    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-model-cache\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:55:21.649559 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.649423    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d-tls-certs\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:55:21.860695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.860660    2555 generic.go:356] "Generic (PLEG): container finished" podID="0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" containerID="af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11" exitCode=0
Jul 11 01:55:21.860869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.860733    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"
Jul 11 01:55:21.860869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.860776    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6" event={"ID":"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d","Type":"ContainerDied","Data":"af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11"}
Jul 11 01:55:21.860869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.860818    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6" event={"ID":"0ffedc90-e5f5-4cc6-a79d-6c295e096f7d","Type":"ContainerDied","Data":"b7f9a13717a9640c32706359e9e1b17447e639d14efa702c94569250da715c2b"}
Jul 11 01:55:21.860869 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.860841    2555 scope.go:117] "RemoveContainer" containerID="af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11"
Jul 11 01:55:21.876243 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.874352    2555 scope.go:117] "RemoveContainer" containerID="af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11"
Jul 11 01:55:21.876243 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:55:21.874937    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11\": container with ID starting with af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11 not found: ID does not exist" containerID="af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11"
Jul 11 01:55:21.876243 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.874972    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11"} err="failed to get container status \"af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11\": rpc error: code = NotFound desc = could not find container \"af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11\": container with ID starting with af62648be570257ba21bd64c95ac15dbf5d839c9215adbb33eda861441f9fe11 not found: ID does not exist"
Jul 11 01:55:21.878155 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.878132    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:55:21.887974 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.887929    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"]
Jul 11 01:55:21.893989 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:21.893899    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/sub-test-model-696ed9-kserve-f988dd4f-tqzx6"]
Jul 11 01:55:22.700303 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:55:22.700264    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" path="/var/lib/kubelet/pods/0ffedc90-e5f5-4cc6-a79d-6c295e096f7d/volumes"
Jul 11 01:56:18.012074 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:56:18.012037    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:56:18.030307 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:56:18.030196    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:56:56.061973 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:56:56.061935    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"]
Jul 11 01:57:00.992144 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.992098    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139624520811568"]
Jul 11 01:57:00.992740 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.992717    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" containerName="main"
Jul 11 01:57:00.992830 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.992743    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" containerName="main"
Jul 11 01:57:00.992897 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.992882    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffedc90-e5f5-4cc6-a79d-6c295e096f7d" containerName="main"
Jul 11 01:57:00.996139 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.996112    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:00.998584 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.998562    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xgmd5\""
Jul 11 01:57:00.999456 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:00.999430    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520811568"]
Jul 11 01:57:01.169810 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.169774    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqnbf\" (UniqueName: \"kubernetes.io/projected/79396332-85d5-4ae1-a272-eeb28772e696-kube-api-access-xqnbf\") pod \"test-curl-7371-139624520811568\" (UID: \"79396332-85d5-4ae1-a272-eeb28772e696\") " pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:01.271121 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.271025    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqnbf\" (UniqueName: \"kubernetes.io/projected/79396332-85d5-4ae1-a272-eeb28772e696-kube-api-access-xqnbf\") pod \"test-curl-7371-139624520811568\" (UID: \"79396332-85d5-4ae1-a272-eeb28772e696\") " pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:01.279448 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.279422    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqnbf\" (UniqueName: \"kubernetes.io/projected/79396332-85d5-4ae1-a272-eeb28772e696-kube-api-access-xqnbf\") pod \"test-curl-7371-139624520811568\" (UID: \"79396332-85d5-4ae1-a272-eeb28772e696\") " pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:01.307676 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.307633    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:01.444650 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.444625    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520811568"]
Jul 11 01:57:01.446066 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:57:01.446029    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79396332_85d5_4ae1_a272_eeb28772e696.slice/crio-dd59df67c0f0fff890c040ff6fba6535b6759fab40180c2dc3435d15384bf7da WatchSource:0}: Error finding container dd59df67c0f0fff890c040ff6fba6535b6759fab40180c2dc3435d15384bf7da: Status 404 returned error can't find the container with id dd59df67c0f0fff890c040ff6fba6535b6759fab40180c2dc3435d15384bf7da
Jul 11 01:57:01.447576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.447554    2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 11 01:57:01.468508 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:01.468479    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520811568" event={"ID":"79396332-85d5-4ae1-a272-eeb28772e696","Type":"ContainerStarted","Data":"dd59df67c0f0fff890c040ff6fba6535b6759fab40180c2dc3435d15384bf7da"}
Jul 11 01:57:02.476360 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:02.476270    2555 generic.go:356] "Generic (PLEG): container finished" podID="79396332-85d5-4ae1-a272-eeb28772e696" containerID="2403998d16e56f7d60bacd13f58f8860b7f7f463afddfdb8a5869cfa5ad66794" exitCode=0
Jul 11 01:57:02.476705 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:02.476358    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520811568" event={"ID":"79396332-85d5-4ae1-a272-eeb28772e696","Type":"ContainerDied","Data":"2403998d16e56f7d60bacd13f58f8860b7f7f463afddfdb8a5869cfa5ad66794"}
Jul 11 01:57:03.630837 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.630808    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:03.668681 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.668643    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139624520811568_79396332-85d5-4ae1-a272-eeb28772e696/test-curl-7371-139624520811568/0.log"
Jul 11 01:57:03.692282 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.692251    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139624520811568"]
Jul 11 01:57:03.694695 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.694669    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqnbf\" (UniqueName: \"kubernetes.io/projected/79396332-85d5-4ae1-a272-eeb28772e696-kube-api-access-xqnbf\") pod \"79396332-85d5-4ae1-a272-eeb28772e696\" (UID: \"79396332-85d5-4ae1-a272-eeb28772e696\") "
Jul 11 01:57:03.695300 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.695280    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139624520811568"]
Jul 11 01:57:03.696723 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.696696    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79396332-85d5-4ae1-a272-eeb28772e696-kube-api-access-xqnbf" (OuterVolumeSpecName: "kube-api-access-xqnbf") pod "79396332-85d5-4ae1-a272-eeb28772e696" (UID: "79396332-85d5-4ae1-a272-eeb28772e696"). InnerVolumeSpecName "kube-api-access-xqnbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:03.796372 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.796332    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqnbf\" (UniqueName: \"kubernetes.io/projected/79396332-85d5-4ae1-a272-eeb28772e696-kube-api-access-xqnbf\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:03.853367 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.853330    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:03.853841 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.853825    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79396332-85d5-4ae1-a272-eeb28772e696" containerName="test-curl-7371-139624520811568"
Jul 11 01:57:03.853841 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.853842    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="79396332-85d5-4ae1-a272-eeb28772e696" containerName="test-curl-7371-139624520811568"
Jul 11 01:57:03.853971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.853918    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="79396332-85d5-4ae1-a272-eeb28772e696" containerName="test-curl-7371-139624520811568"
Jul 11 01:57:03.857123 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.857094    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:03.859879 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.859852    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:03.896940 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.896903    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24qq\" (UniqueName: \"kubernetes.io/projected/a334ed02-5668-4042-bbf8-320146ab191d-kube-api-access-c24qq\") pod \"test-curl-7371-139624520296752\" (UID: \"a334ed02-5668-4042-bbf8-320146ab191d\") " pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:03.997829 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:03.997799    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24qq\" (UniqueName: \"kubernetes.io/projected/a334ed02-5668-4042-bbf8-320146ab191d-kube-api-access-c24qq\") pod \"test-curl-7371-139624520296752\" (UID: \"a334ed02-5668-4042-bbf8-320146ab191d\") " pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:04.006169 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.006143    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24qq\" (UniqueName: \"kubernetes.io/projected/a334ed02-5668-4042-bbf8-320146ab191d-kube-api-access-c24qq\") pod \"test-curl-7371-139624520296752\" (UID: \"a334ed02-5668-4042-bbf8-320146ab191d\") " pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:04.168082 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.167994    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:04.304878 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.304851    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:04.306141 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:57:04.306111    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda334ed02_5668_4042_bbf8_320146ab191d.slice/crio-7e06fb0260a7a744903acfec5320cef1d7ced6d135cc517d2f2c353d864023e3 WatchSource:0}: Error finding container 7e06fb0260a7a744903acfec5320cef1d7ced6d135cc517d2f2c353d864023e3: Status 404 returned error can't find the container with id 7e06fb0260a7a744903acfec5320cef1d7ced6d135cc517d2f2c353d864023e3
Jul 11 01:57:04.490765 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.490683    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:04.490765 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.490690    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd59df67c0f0fff890c040ff6fba6535b6759fab40180c2dc3435d15384bf7da"
Jul 11 01:57:04.492125 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.492095    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520296752" event={"ID":"a334ed02-5668-4042-bbf8-320146ab191d","Type":"ContainerStarted","Data":"7e06fb0260a7a744903acfec5320cef1d7ced6d135cc517d2f2c353d864023e3"}
Jul 11 01:57:04.501740 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:57:04.501713    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-139624520811568\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="79396332-85d5-4ae1-a272-eeb28772e696" pod="openshift-ingress/test-curl-7371-139624520811568"
Jul 11 01:57:04.703680 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:04.703652    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79396332-85d5-4ae1-a272-eeb28772e696" path="/var/lib/kubelet/pods/79396332-85d5-4ae1-a272-eeb28772e696/volumes"
Jul 11 01:57:05.499750 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:05.499714    2555 generic.go:356] "Generic (PLEG): container finished" podID="a334ed02-5668-4042-bbf8-320146ab191d" containerID="752ed6119609cfcf2bc6c993f341aac325a4fe8a8e573a0e4c787bf5aa363e55" exitCode=0
Jul 11 01:57:05.499980 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:05.499804    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520296752" event={"ID":"a334ed02-5668-4042-bbf8-320146ab191d","Type":"ContainerDied","Data":"752ed6119609cfcf2bc6c993f341aac325a4fe8a8e573a0e4c787bf5aa363e55"}
Jul 11 01:57:06.651912 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.651887    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:06.671690 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.671663    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139624520296752_a334ed02-5668-4042-bbf8-320146ab191d/test-curl-7371-139624520296752/0.log"
Jul 11 01:57:06.701397 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.701372    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:06.701543 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.701409    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:06.723019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.722991    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c24qq\" (UniqueName: \"kubernetes.io/projected/a334ed02-5668-4042-bbf8-320146ab191d-kube-api-access-c24qq\") pod \"a334ed02-5668-4042-bbf8-320146ab191d\" (UID: \"a334ed02-5668-4042-bbf8-320146ab191d\") "
Jul 11 01:57:06.725341 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.725311    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a334ed02-5668-4042-bbf8-320146ab191d-kube-api-access-c24qq" (OuterVolumeSpecName: "kube-api-access-c24qq") pod "a334ed02-5668-4042-bbf8-320146ab191d" (UID: "a334ed02-5668-4042-bbf8-320146ab191d"). InnerVolumeSpecName "kube-api-access-c24qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:06.823895 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.823861    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c24qq\" (UniqueName: \"kubernetes.io/projected/a334ed02-5668-4042-bbf8-320146ab191d-kube-api-access-c24qq\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:06.824435 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.824414    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:06.824835 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.824822    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a334ed02-5668-4042-bbf8-320146ab191d" containerName="test-curl-7371-139624520296752"
Jul 11 01:57:06.824875 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.824836    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a334ed02-5668-4042-bbf8-320146ab191d" containerName="test-curl-7371-139624520296752"
Jul 11 01:57:06.824921 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.824912    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a334ed02-5668-4042-bbf8-320146ab191d" containerName="test-curl-7371-139624520296752"
Jul 11 01:57:06.828064 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.828048    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:06.831713 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.831686    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:06.925034 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:06.925007    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddtz\" (UniqueName: \"kubernetes.io/projected/9745eb2b-3a96-4550-90bf-775295aeba60-kube-api-access-mddtz\") pod \"test-curl-7371-139624520296752\" (UID: \"9745eb2b-3a96-4550-90bf-775295aeba60\") " pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:07.026123 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.026074    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddtz\" (UniqueName: \"kubernetes.io/projected/9745eb2b-3a96-4550-90bf-775295aeba60-kube-api-access-mddtz\") pod \"test-curl-7371-139624520296752\" (UID: \"9745eb2b-3a96-4550-90bf-775295aeba60\") " pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:07.034925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.034897    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddtz\" (UniqueName: \"kubernetes.io/projected/9745eb2b-3a96-4550-90bf-775295aeba60-kube-api-access-mddtz\") pod \"test-curl-7371-139624520296752\" (UID: \"9745eb2b-3a96-4550-90bf-775295aeba60\") " pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:07.138920 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.138830    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:07.279225 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.279184    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:07.281809 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:57:07.281781    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9745eb2b_3a96_4550_90bf_775295aeba60.slice/crio-0f13f87cfe5a872d4242247fea17674295a168a90d1112f9fc2f3b268e1095d5 WatchSource:0}: Error finding container 0f13f87cfe5a872d4242247fea17674295a168a90d1112f9fc2f3b268e1095d5: Status 404 returned error can't find the container with id 0f13f87cfe5a872d4242247fea17674295a168a90d1112f9fc2f3b268e1095d5
Jul 11 01:57:07.512493 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.512408    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:07.512493 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.512444    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e06fb0260a7a744903acfec5320cef1d7ced6d135cc517d2f2c353d864023e3"
Jul 11 01:57:07.513701 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.513676    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520296752" event={"ID":"9745eb2b-3a96-4550-90bf-775295aeba60","Type":"ContainerStarted","Data":"0f13f87cfe5a872d4242247fea17674295a168a90d1112f9fc2f3b268e1095d5"}
Jul 11 01:57:07.523898 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:07.523870    2555 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7371-139624520296752" oldPodUID="a334ed02-5668-4042-bbf8-320146ab191d" podUID="9745eb2b-3a96-4550-90bf-775295aeba60"
Jul 11 01:57:08.523399 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:08.523362    2555 generic.go:356] "Generic (PLEG): container finished" podID="9745eb2b-3a96-4550-90bf-775295aeba60" containerID="4f6c23e597c34b1648c06d6e1340edef26351083950fa7bcd8af9dcacd96e1ba" exitCode=0
Jul 11 01:57:08.523849 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:08.523444    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520296752" event={"ID":"9745eb2b-3a96-4550-90bf-775295aeba60","Type":"ContainerDied","Data":"4f6c23e597c34b1648c06d6e1340edef26351083950fa7bcd8af9dcacd96e1ba"}
Jul 11 01:57:08.700100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:08.700064    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a334ed02-5668-4042-bbf8-320146ab191d" path="/var/lib/kubelet/pods/a334ed02-5668-4042-bbf8-320146ab191d/volumes"
Jul 11 01:57:09.687943 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.687917    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:09.708686 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.708656    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139624520296752_9745eb2b-3a96-4550-90bf-775295aeba60/test-curl-7371-139624520296752/0.log"
Jul 11 01:57:09.735590 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.735558    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:09.738463 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.738442    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139624520296752"]
Jul 11 01:57:09.759981 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.759946    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mddtz\" (UniqueName: \"kubernetes.io/projected/9745eb2b-3a96-4550-90bf-775295aeba60-kube-api-access-mddtz\") pod \"9745eb2b-3a96-4550-90bf-775295aeba60\" (UID: \"9745eb2b-3a96-4550-90bf-775295aeba60\") "
Jul 11 01:57:09.762139 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.762107    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9745eb2b-3a96-4550-90bf-775295aeba60-kube-api-access-mddtz" (OuterVolumeSpecName: "kube-api-access-mddtz") pod "9745eb2b-3a96-4550-90bf-775295aeba60" (UID: "9745eb2b-3a96-4550-90bf-775295aeba60"). InnerVolumeSpecName "kube-api-access-mddtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:09.849228 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.849121    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:09.849755 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.849734    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9745eb2b-3a96-4550-90bf-775295aeba60" containerName="test-curl-7371-139624520296752"
Jul 11 01:57:09.849807 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.849761    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9745eb2b-3a96-4550-90bf-775295aeba60" containerName="test-curl-7371-139624520296752"
Jul 11 01:57:09.849909 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.849897    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9745eb2b-3a96-4550-90bf-775295aeba60" containerName="test-curl-7371-139624520296752"
Jul 11 01:57:09.853466 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.853444    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:09.859080 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.859057    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:09.861042 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.861019    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mddtz\" (UniqueName: \"kubernetes.io/projected/9745eb2b-3a96-4550-90bf-775295aeba60-kube-api-access-mddtz\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:09.962617 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:09.962576    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ds5\" (UniqueName: \"kubernetes.io/projected/763c8937-8bd9-4a8c-a336-615d65319ef6-kube-api-access-j7ds5\") pod \"test-curl-7371-139624520297760\" (UID: \"763c8937-8bd9-4a8c-a336-615d65319ef6\") " pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:10.063568 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.063532    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ds5\" (UniqueName: \"kubernetes.io/projected/763c8937-8bd9-4a8c-a336-615d65319ef6-kube-api-access-j7ds5\") pod \"test-curl-7371-139624520297760\" (UID: \"763c8937-8bd9-4a8c-a336-615d65319ef6\") " pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:10.071563 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.071532    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ds5\" (UniqueName: \"kubernetes.io/projected/763c8937-8bd9-4a8c-a336-615d65319ef6-kube-api-access-j7ds5\") pod \"test-curl-7371-139624520297760\" (UID: \"763c8937-8bd9-4a8c-a336-615d65319ef6\") " pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:10.164525 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.164442    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:10.304424 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.304398    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:10.305748 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:57:10.305722    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod763c8937_8bd9_4a8c_a336_615d65319ef6.slice/crio-969b90a4d17db5d46c616598f5bc398e8aaa48a5c047f5d4edc6579f1e174b57 WatchSource:0}: Error finding container 969b90a4d17db5d46c616598f5bc398e8aaa48a5c047f5d4edc6579f1e174b57: Status 404 returned error can't find the container with id 969b90a4d17db5d46c616598f5bc398e8aaa48a5c047f5d4edc6579f1e174b57
Jul 11 01:57:10.538700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.538661    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520297760" event={"ID":"763c8937-8bd9-4a8c-a336-615d65319ef6","Type":"ContainerStarted","Data":"969b90a4d17db5d46c616598f5bc398e8aaa48a5c047f5d4edc6579f1e174b57"}
Jul 11 01:57:10.539960 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.539940    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f13f87cfe5a872d4242247fea17674295a168a90d1112f9fc2f3b268e1095d5"
Jul 11 01:57:10.540089 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.539967    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:10.550480 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:57:10.550451    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-139624520296752\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="9745eb2b-3a96-4550-90bf-775295aeba60" pod="openshift-ingress/test-curl-7371-139624520296752"
Jul 11 01:57:10.704263 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:10.704234    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9745eb2b-3a96-4550-90bf-775295aeba60" path="/var/lib/kubelet/pods/9745eb2b-3a96-4550-90bf-775295aeba60/volumes"
Jul 11 01:57:11.081711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.081665    2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b" podUID="dc014cdd-345e-4176-964a-0dd9793d5c57" containerName="main" containerID="cri-o://9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5" gracePeriod=45
Jul 11 01:57:11.344322 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.344262    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:57:11.374901 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.374871    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc014cdd-345e-4176-964a-0dd9793d5c57-tls-certs\") pod \"dc014cdd-345e-4176-964a-0dd9793d5c57\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") "
Jul 11 01:57:11.375059 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.374938    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-tmp-dir\") pod \"dc014cdd-345e-4176-964a-0dd9793d5c57\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") "
Jul 11 01:57:11.375059 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375005    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-home\") pod \"dc014cdd-345e-4176-964a-0dd9793d5c57\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") "
Jul 11 01:57:11.375059 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375027    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-model-cache\") pod \"dc014cdd-345e-4176-964a-0dd9793d5c57\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") "
Jul 11 01:57:11.375059 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375046    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4jwk\" (UniqueName: \"kubernetes.io/projected/dc014cdd-345e-4176-964a-0dd9793d5c57-kube-api-access-z4jwk\") pod \"dc014cdd-345e-4176-964a-0dd9793d5c57\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") "
Jul 11 01:57:11.375304 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375070    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-dshm\") pod \"dc014cdd-345e-4176-964a-0dd9793d5c57\" (UID: \"dc014cdd-345e-4176-964a-0dd9793d5c57\") "
Jul 11 01:57:11.375304 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375212    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dc014cdd-345e-4176-964a-0dd9793d5c57" (UID: "dc014cdd-345e-4176-964a-0dd9793d5c57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:11.375427 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375330    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-model-cache" (OuterVolumeSpecName: "model-cache") pod "dc014cdd-345e-4176-964a-0dd9793d5c57" (UID: "dc014cdd-345e-4176-964a-0dd9793d5c57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:11.375427 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375360    2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-tmp-dir\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:11.375622 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.375598    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-home" (OuterVolumeSpecName: "home") pod "dc014cdd-345e-4176-964a-0dd9793d5c57" (UID: "dc014cdd-345e-4176-964a-0dd9793d5c57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:11.377232 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.377188    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-dshm" (OuterVolumeSpecName: "dshm") pod "dc014cdd-345e-4176-964a-0dd9793d5c57" (UID: "dc014cdd-345e-4176-964a-0dd9793d5c57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 11 01:57:11.377508 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.377482    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc014cdd-345e-4176-964a-0dd9793d5c57-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dc014cdd-345e-4176-964a-0dd9793d5c57" (UID: "dc014cdd-345e-4176-964a-0dd9793d5c57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 11 01:57:11.377508 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.377497    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc014cdd-345e-4176-964a-0dd9793d5c57-kube-api-access-z4jwk" (OuterVolumeSpecName: "kube-api-access-z4jwk") pod "dc014cdd-345e-4176-964a-0dd9793d5c57" (UID: "dc014cdd-345e-4176-964a-0dd9793d5c57"). InnerVolumeSpecName "kube-api-access-z4jwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:11.476648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.476615    2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-model-cache\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:11.476648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.476642    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4jwk\" (UniqueName: \"kubernetes.io/projected/dc014cdd-345e-4176-964a-0dd9793d5c57-kube-api-access-z4jwk\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:11.476648 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.476652    2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-dshm\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:11.476881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.476661    2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc014cdd-345e-4176-964a-0dd9793d5c57-tls-certs\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:11.476881 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.476670    2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc014cdd-345e-4176-964a-0dd9793d5c57-home\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:11.547785 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.547750    2555 generic.go:356] "Generic (PLEG): container finished" podID="763c8937-8bd9-4a8c-a336-615d65319ef6" containerID="c69e71f78d030ff1b56381624704f1757c8ec4723c00100945f0c85777742dfa" exitCode=0
Jul 11 01:57:11.547965 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.547798    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520297760" event={"ID":"763c8937-8bd9-4a8c-a336-615d65319ef6","Type":"ContainerDied","Data":"c69e71f78d030ff1b56381624704f1757c8ec4723c00100945f0c85777742dfa"}
Jul 11 01:57:11.549156 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.549131    2555 generic.go:356] "Generic (PLEG): container finished" podID="dc014cdd-345e-4176-964a-0dd9793d5c57" containerID="9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5" exitCode=0
Jul 11 01:57:11.549347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.549163    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b" event={"ID":"dc014cdd-345e-4176-964a-0dd9793d5c57","Type":"ContainerDied","Data":"9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5"}
Jul 11 01:57:11.549347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.549171    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"
Jul 11 01:57:11.549347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.549196    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b" event={"ID":"dc014cdd-345e-4176-964a-0dd9793d5c57","Type":"ContainerDied","Data":"fbde0bc17a3bc409b43b7196ba1fbb9edb46cd0883474cd0544957074ae92e92"}
Jul 11 01:57:11.549347 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.549236    2555 scope.go:117] "RemoveContainer" containerID="9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5"
Jul 11 01:57:11.558780 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.558679    2555 scope.go:117] "RemoveContainer" containerID="9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5"
Jul 11 01:57:11.559024 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:57:11.558998    2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5\": container with ID starting with 9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5 not found: ID does not exist" containerID="9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5"
Jul 11 01:57:11.559124 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.559034    2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5"} err="failed to get container status \"9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5\": rpc error: code = NotFound desc = could not find container \"9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5\": container with ID starting with 9f6fafcf32e1a459fdbef32603c371f00bbb6903351c41a65032cb2f25d738e5 not found: ID does not exist"
Jul 11 01:57:11.574498 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.574472    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"]
Jul 11 01:57:11.580048 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:11.580026    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-696ed9/rate-test-model-696ed9-kserve-757db584bc-vwt7b"]
Jul 11 01:57:12.702081 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.702050    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc014cdd-345e-4176-964a-0dd9793d5c57" path="/var/lib/kubelet/pods/dc014cdd-345e-4176-964a-0dd9793d5c57/volumes"
Jul 11 01:57:12.710345 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.710321    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:12.729906 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.729882    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139624520297760_763c8937-8bd9-4a8c-a336-615d65319ef6/test-curl-7371-139624520297760/0.log"
Jul 11 01:57:12.755088 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.755050    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:12.760743 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.760712    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:12.794254 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.794194    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7ds5\" (UniqueName: \"kubernetes.io/projected/763c8937-8bd9-4a8c-a336-615d65319ef6-kube-api-access-j7ds5\") pod \"763c8937-8bd9-4a8c-a336-615d65319ef6\" (UID: \"763c8937-8bd9-4a8c-a336-615d65319ef6\") "
Jul 11 01:57:12.796279 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.796254    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763c8937-8bd9-4a8c-a336-615d65319ef6-kube-api-access-j7ds5" (OuterVolumeSpecName: "kube-api-access-j7ds5") pod "763c8937-8bd9-4a8c-a336-615d65319ef6" (UID: "763c8937-8bd9-4a8c-a336-615d65319ef6"). InnerVolumeSpecName "kube-api-access-j7ds5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:12.879454 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879372    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:12.879808 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879795    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763c8937-8bd9-4a8c-a336-615d65319ef6" containerName="test-curl-7371-139624520297760"
Jul 11 01:57:12.879851 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879809    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="763c8937-8bd9-4a8c-a336-615d65319ef6" containerName="test-curl-7371-139624520297760"
Jul 11 01:57:12.879851 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879828    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc014cdd-345e-4176-964a-0dd9793d5c57" containerName="main"
Jul 11 01:57:12.879851 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879834    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc014cdd-345e-4176-964a-0dd9793d5c57" containerName="main"
Jul 11 01:57:12.879942 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879909    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc014cdd-345e-4176-964a-0dd9793d5c57" containerName="main"
Jul 11 01:57:12.879942 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.879916    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="763c8937-8bd9-4a8c-a336-615d65319ef6" containerName="test-curl-7371-139624520297760"
Jul 11 01:57:12.882919 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.882902    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:12.888986 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.888960    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:12.895925 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.895891    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7ds5\" (UniqueName: \"kubernetes.io/projected/763c8937-8bd9-4a8c-a336-615d65319ef6-kube-api-access-j7ds5\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:12.997290 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:12.997253    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6tsh\" (UniqueName: \"kubernetes.io/projected/06b5947d-6373-4c16-87fd-faf6ccc1b4d8-kube-api-access-w6tsh\") pod \"test-curl-7371-139624520297760\" (UID: \"06b5947d-6373-4c16-87fd-faf6ccc1b4d8\") " pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:13.098077 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.098038    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6tsh\" (UniqueName: \"kubernetes.io/projected/06b5947d-6373-4c16-87fd-faf6ccc1b4d8-kube-api-access-w6tsh\") pod \"test-curl-7371-139624520297760\" (UID: \"06b5947d-6373-4c16-87fd-faf6ccc1b4d8\") " pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:13.107103 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.107068    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6tsh\" (UniqueName: \"kubernetes.io/projected/06b5947d-6373-4c16-87fd-faf6ccc1b4d8-kube-api-access-w6tsh\") pod \"test-curl-7371-139624520297760\" (UID: \"06b5947d-6373-4c16-87fd-faf6ccc1b4d8\") " pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:13.193671 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.193579    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:13.332769 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.332743    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:13.333767 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:57:13.333738    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06b5947d_6373_4c16_87fd_faf6ccc1b4d8.slice/crio-6e8710a087522989d079ec2c11170b4eab0fd97998a7ff7d28772dc5bcfdbff4 WatchSource:0}: Error finding container 6e8710a087522989d079ec2c11170b4eab0fd97998a7ff7d28772dc5bcfdbff4: Status 404 returned error can't find the container with id 6e8710a087522989d079ec2c11170b4eab0fd97998a7ff7d28772dc5bcfdbff4
Jul 11 01:57:13.564399 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.564352    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520297760" event={"ID":"06b5947d-6373-4c16-87fd-faf6ccc1b4d8","Type":"ContainerStarted","Data":"6e8710a087522989d079ec2c11170b4eab0fd97998a7ff7d28772dc5bcfdbff4"}
Jul 11 01:57:13.565686 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.565667    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:13.565808 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.565701    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="969b90a4d17db5d46c616598f5bc398e8aaa48a5c047f5d4edc6579f1e174b57"
Jul 11 01:57:13.576851 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:13.576818    2555 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7371-139624520297760" oldPodUID="763c8937-8bd9-4a8c-a336-615d65319ef6" podUID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8"
Jul 11 01:57:14.573332 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:14.573299    2555 generic.go:356] "Generic (PLEG): container finished" podID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8" containerID="4d9c0e6c9eba407227403463a2f7240b38f0a383c8f0261235232f1a9317e26b" exitCode=0
Jul 11 01:57:14.573744 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:14.573388    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139624520297760" event={"ID":"06b5947d-6373-4c16-87fd-faf6ccc1b4d8","Type":"ContainerDied","Data":"4d9c0e6c9eba407227403463a2f7240b38f0a383c8f0261235232f1a9317e26b"}
Jul 11 01:57:14.700544 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:14.700512    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763c8937-8bd9-4a8c-a336-615d65319ef6" path="/var/lib/kubelet/pods/763c8937-8bd9-4a8c-a336-615d65319ef6/volumes"
Jul 11 01:57:15.724613 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.724585    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:15.743818 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.743790    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139624520297760_06b5947d-6373-4c16-87fd-faf6ccc1b4d8/test-curl-7371-139624520297760/0.log"
Jul 11 01:57:15.770059 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.770012    2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:15.774739 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.774701    2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139624520297760"]
Jul 11 01:57:15.823014 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.822978    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6tsh\" (UniqueName: \"kubernetes.io/projected/06b5947d-6373-4c16-87fd-faf6ccc1b4d8-kube-api-access-w6tsh\") pod \"06b5947d-6373-4c16-87fd-faf6ccc1b4d8\" (UID: \"06b5947d-6373-4c16-87fd-faf6ccc1b4d8\") "
Jul 11 01:57:15.825167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.825134    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b5947d-6373-4c16-87fd-faf6ccc1b4d8-kube-api-access-w6tsh" (OuterVolumeSpecName: "kube-api-access-w6tsh") pod "06b5947d-6373-4c16-87fd-faf6ccc1b4d8" (UID: "06b5947d-6373-4c16-87fd-faf6ccc1b4d8"). InnerVolumeSpecName "kube-api-access-w6tsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 11 01:57:15.924585 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:15.924550    2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6tsh\" (UniqueName: \"kubernetes.io/projected/06b5947d-6373-4c16-87fd-faf6ccc1b4d8-kube-api-access-w6tsh\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:16.585845 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:16.585815    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:16.586001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:16.585847    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e8710a087522989d079ec2c11170b4eab0fd97998a7ff7d28772dc5bcfdbff4"
Jul 11 01:57:16.596008 ip-10-0-139-236 kubenswrapper[2555]: E0711 01:57:16.595981    2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7371-139624520297760\" is forbidden: User \"system:node:ip-10-0-139-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-236.ec2.internal' and this object" podUID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8" pod="openshift-ingress/test-curl-7371-139624520297760"
Jul 11 01:57:16.700393 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:16.700364    2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8" path="/var/lib/kubelet/pods/06b5947d-6373-4c16-87fd-faf6ccc1b4d8/volumes"
Jul 11 01:57:42.060167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.060128    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"]
Jul 11 01:57:42.060665 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.060578    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8" containerName="test-curl-7371-139624520297760"
Jul 11 01:57:42.060665 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.060592    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8" containerName="test-curl-7371-139624520297760"
Jul 11 01:57:42.060740 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.060670    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b5947d-6373-4c16-87fd-faf6ccc1b4d8" containerName="test-curl-7371-139624520297760"
Jul 11 01:57:42.065734 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.065714    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:42.068711 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.068679    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-snttp\""
Jul 11 01:57:42.071110 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.071088    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"]
Jul 11 01:57:42.169931 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.169889    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3705c10-1d56-4b92-98e2-177037359014-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt\" (UID: \"f3705c10-1d56-4b92-98e2-177037359014\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:42.271273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.271230    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3705c10-1d56-4b92-98e2-177037359014-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt\" (UID: \"f3705c10-1d56-4b92-98e2-177037359014\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:42.271929 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.271903    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3705c10-1d56-4b92-98e2-177037359014-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt\" (UID: \"f3705c10-1d56-4b92-98e2-177037359014\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:42.378304 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.378183    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:42.524872 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.524843    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"]
Jul 11 01:57:42.526379 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:57:42.526354    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3705c10_1d56_4b92_98e2_177037359014.slice/crio-9e24d23503ddc5ea756835db855e859f03bf34c69c88385d09de294941b2bd2c WatchSource:0}: Error finding container 9e24d23503ddc5ea756835db855e859f03bf34c69c88385d09de294941b2bd2c: Status 404 returned error can't find the container with id 9e24d23503ddc5ea756835db855e859f03bf34c69c88385d09de294941b2bd2c
Jul 11 01:57:42.755293 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:42.755177    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt" event={"ID":"f3705c10-1d56-4b92-98e2-177037359014","Type":"ContainerStarted","Data":"9e24d23503ddc5ea756835db855e859f03bf34c69c88385d09de294941b2bd2c"}
Jul 11 01:57:43.763478 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:43.763380    2555 generic.go:356] "Generic (PLEG): container finished" podID="f3705c10-1d56-4b92-98e2-177037359014" containerID="ff56f9ac6baa348e3faf27a8140e4735b7a081c1b460940ef2f3533873952b4e" exitCode=0
Jul 11 01:57:43.763849 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:43.763475    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt" event={"ID":"f3705c10-1d56-4b92-98e2-177037359014","Type":"ContainerDied","Data":"ff56f9ac6baa348e3faf27a8140e4735b7a081c1b460940ef2f3533873952b4e"}
Jul 11 01:57:44.908377 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:44.908353    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:44.998530 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:44.998498    2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3705c10-1d56-4b92-98e2-177037359014-maas-api-service-ca\") pod \"f3705c10-1d56-4b92-98e2-177037359014\" (UID: \"f3705c10-1d56-4b92-98e2-177037359014\") "
Jul 11 01:57:44.998890 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:44.998870    2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3705c10-1d56-4b92-98e2-177037359014-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f3705c10-1d56-4b92-98e2-177037359014" (UID: "f3705c10-1d56-4b92-98e2-177037359014"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 11 01:57:45.099787 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:45.099743    2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3705c10-1d56-4b92-98e2-177037359014-maas-api-service-ca\") on node \"ip-10-0-139-236.ec2.internal\" DevicePath \"\""
Jul 11 01:57:45.777398 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:45.777368    2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt"
Jul 11 01:57:45.777607 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:45.777402    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt" event={"ID":"f3705c10-1d56-4b92-98e2-177037359014","Type":"ContainerDied","Data":"9e24d23503ddc5ea756835db855e859f03bf34c69c88385d09de294941b2bd2c"}
Jul 11 01:57:45.777607 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:57:45.777450    2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e24d23503ddc5ea756835db855e859f03bf34c69c88385d09de294941b2bd2c"
Jul 11 01:58:08.432167 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:08.432131    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f9747f6c4-29gcx_1274cbef-1dc3-4a34-b523-d95d8323e726/authorino/0.log"
Jul 11 01:58:13.097805 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.097773    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zdlfx_de8cd025-87a0-4c49-bf64-23b855c0f542/manager/0.log"
Jul 11 01:58:13.210557 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.210523    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m6t6n_0a291201-6be2-4356-80fa-1991a6a7b377/manager/0.log"
Jul 11 01:58:13.324574 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.324550    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-558bfbff58-m2rxb_35ad9b2e-9a27-45ab-8b6b-766957c41b76/manager/0.log"
Jul 11 01:58:13.433700 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.433613    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkl4l_70e3472a-885d-4608-9a5a-1f0769640af2/server/0.log"
Jul 11 01:58:13.545447 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.545423    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kfvn6_6a2dd919-8714-4b98-9e55-26e28e7cca13/manager/0.log"
Jul 11 01:58:13.652799 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.652771    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-m9445_1add6ff3-1f90-47d2-a702-0819c34b0667/copy-manifests/0.log"
Jul 11 01:58:13.664692 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:13.664661    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-m9445_1add6ff3-1f90-47d2-a702-0819c34b0667/manager/0.log"
Jul 11 01:58:14.266937 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:14.266911    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5cb5b66ff-mc28f_be57b10a-a313-459a-9ebd-2f3223ac456c/maas-api/0.log"
Jul 11 01:58:14.477673 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:14.477648    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29728905-tz2fp_499d4caa-ba4b-4788-8207-0ae7a21fc5f3/cleanup/0.log"
Jul 11 01:58:14.585306 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:14.585274    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-0e2b807a-2xkzz_b40a0cbe-d170-4a66-ba7b-4dc1c9b9e1d3/revoke-keys/0.log"
Jul 11 01:58:14.907307 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:14.907230    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-124c39-gxvm6_d117e091-a38e-41fe-85c1-8db849b1bb46/revoke-keys/0.log"
Jul 11 01:58:15.229535 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:15.229459    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-1e79cd-gjfpx_1cf71943-d319-4d9c-9e52-794ab3f12b49/revoke-keys/0.log"
Jul 11 01:58:15.440768 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:15.440741    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-37fb922a-w9q4m_17a0fee9-3c47-40b4-8f9f-71de203398fd/revoke-keys/0.log"
Jul 11 01:58:15.542701 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:15.542676    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-83b6ef8d-cvkcx_ae9237df-1f6a-49b5-af58-b0d606a1c128/revoke-keys/0.log"
Jul 11 01:58:15.751870 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:15.751837    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-98dbcb-k5dvt_f3705c10-1d56-4b92-98e2-177037359014/revoke-keys/0.log"
Jul 11 01:58:15.857808 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:15.857724    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-s8kww_655a1557-fad4-4467-bfa6-1b0ba4ce2350/postgres/0.log"
Jul 11 01:58:16.602527 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.602497    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr_af939131-a167-4e6c-b32d-557f2cecc631/util/0.log"
Jul 11 01:58:16.608772 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.608743    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr_af939131-a167-4e6c-b32d-557f2cecc631/pull/0.log"
Jul 11 01:58:16.614246 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.614218    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr_af939131-a167-4e6c-b32d-557f2cecc631/extract/0.log"
Jul 11 01:58:16.719301 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.719275    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw_023b27bc-97c8-44f4-919c-043473556c3b/util/0.log"
Jul 11 01:58:16.725579 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.725556    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw_023b27bc-97c8-44f4-919c-043473556c3b/pull/0.log"
Jul 11 01:58:16.731761 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.731742    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw_023b27bc-97c8-44f4-919c-043473556c3b/extract/0.log"
Jul 11 01:58:16.844253 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.844197    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2_f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8/util/0.log"
Jul 11 01:58:16.849704 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.849683    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2_f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8/pull/0.log"
Jul 11 01:58:16.857247 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.857169    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2_f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8/extract/0.log"
Jul 11 01:58:16.962334 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.962303    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg_6100aeb6-4006-4d00-b100-0021cca9c32d/util/0.log"
Jul 11 01:58:16.973392 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.973364    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg_6100aeb6-4006-4d00-b100-0021cca9c32d/pull/0.log"
Jul 11 01:58:16.979042 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:16.979016    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg_6100aeb6-4006-4d00-b100-0021cca9c32d/extract/0.log"
Jul 11 01:58:17.087548 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:17.087518    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f9747f6c4-29gcx_1274cbef-1dc3-4a34-b523-d95d8323e726/authorino/0.log"
Jul 11 01:58:17.195522 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:17.195435    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pkxpd_0bb2c466-185e-4307-9664-9882b04b33b3/manager/0.log"
Jul 11 01:58:17.524055 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:17.523979    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t95dg_9fdcc432-9721-45a8-83c8-6683b0f8297e/registry-server/0.log"
Jul 11 01:58:17.641280 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:17.641249    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-krm4s_428ff5b7-7da5-489d-a05c-ec0d5e616bde/manager/0.log"
Jul 11 01:58:17.854470 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:17.854438    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w9v5j_1a0943ec-27c5-484e-8f6a-884b24b0f8a2/manager/0.log"
Jul 11 01:58:18.511321 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:18.511291    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-56wjm_9cdfd765-5040-4995-927f-d8600edf8a8d/kube-auth-proxy/0.log"
Jul 11 01:58:18.739892 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:18.739864    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qrm2j_eda7919e-1048-45b4-b8cb-8f75a2f0c4bc/payload-pre-processing/0.log"
Jul 11 01:58:18.852353 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:18.852328    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-2g597_7b20d699-5da3-4d25-b514-e25b8a8d9c0d/payload-processing/0.log"
Jul 11 01:58:18.955710 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:18.955682    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4b6c4b64-bdp2p_c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb/router/0.log"
Jul 11 01:58:19.393961 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:19.393937    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2d62d_d57c617a-3f40-4aa1-8edc-7de23c868a2a/main/0.log"
Jul 11 01:58:19.604227 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:19.604171    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblxzvg_ff6280a5-8403-490b-9a29-634cc8b62b6f/main/0.log"
Jul 11 01:58:26.510631 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:26.510602    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2rhwb_8a4945cf-0c27-46d5-bda4-074df6f855e0/global-pull-secret-syncer/0.log"
Jul 11 01:58:26.710963 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:26.710938    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vpd55_68c7e928-54b0-4ddf-a551-7437bc054861/konnectivity-agent/0.log"
Jul 11 01:58:26.755081 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:26.755054    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-236.ec2.internal_c5c935c4e7d4f5442a1b6401a457b6f4/haproxy/0.log"
Jul 11 01:58:30.794041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.794012    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr_af939131-a167-4e6c-b32d-557f2cecc631/extract/0.log"
Jul 11 01:58:30.815727 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.815694    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr_af939131-a167-4e6c-b32d-557f2cecc631/util/0.log"
Jul 11 01:58:30.848332 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.848312    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z5xfr_af939131-a167-4e6c-b32d-557f2cecc631/pull/0.log"
Jul 11 01:58:30.873213 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.873187    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw_023b27bc-97c8-44f4-919c-043473556c3b/extract/0.log"
Jul 11 01:58:30.892972 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.892951    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw_023b27bc-97c8-44f4-919c-043473556c3b/util/0.log"
Jul 11 01:58:30.918918 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.918895    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vvkqw_023b27bc-97c8-44f4-919c-043473556c3b/pull/0.log"
Jul 11 01:58:30.959465 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.959439    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2_f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8/extract/0.log"
Jul 11 01:58:30.983117 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:30.983088    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2_f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8/util/0.log"
Jul 11 01:58:31.008238 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.008193    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h9kv2_f5a7e9e2-8b93-4e4a-a968-887f48f5f3f8/pull/0.log"
Jul 11 01:58:31.035599 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.035574    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg_6100aeb6-4006-4d00-b100-0021cca9c32d/extract/0.log"
Jul 11 01:58:31.059318 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.059255    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg_6100aeb6-4006-4d00-b100-0021cca9c32d/util/0.log"
Jul 11 01:58:31.089651 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.089628    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17lltg_6100aeb6-4006-4d00-b100-0021cca9c32d/pull/0.log"
Jul 11 01:58:31.429573 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.429489    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f9747f6c4-29gcx_1274cbef-1dc3-4a34-b523-d95d8323e726/authorino/0.log"
Jul 11 01:58:31.457628 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.457602    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pkxpd_0bb2c466-185e-4307-9664-9882b04b33b3/manager/0.log"
Jul 11 01:58:31.570286 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.570257    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t95dg_9fdcc432-9721-45a8-83c8-6683b0f8297e/registry-server/0.log"
Jul 11 01:58:31.693817 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.693726    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-krm4s_428ff5b7-7da5-489d-a05c-ec0d5e616bde/manager/0.log"
Jul 11 01:58:31.787922 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:31.787886    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w9v5j_1a0943ec-27c5-484e-8f6a-884b24b0f8a2/manager/0.log"
Jul 11 01:58:33.493282 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:33.493246    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-l5br6_8a3dc3a0-1b35-442e-bd5c-745ee4130cdd/cluster-monitoring-operator/0.log"
Jul 11 01:58:33.610872 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:33.610843    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-j5vjn_6fd5a735-30ca-4217-911c-b0d0265fa8ad/monitoring-plugin/0.log"
Jul 11 01:58:33.821417 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:33.821386    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wm5bw_3b6fbc2f-6e7d-447e-a117-2437a8787a37/node-exporter/0.log"
Jul 11 01:58:33.849757 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:33.849732    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wm5bw_3b6fbc2f-6e7d-447e-a117-2437a8787a37/kube-rbac-proxy/0.log"
Jul 11 01:58:33.872073 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:33.872052    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wm5bw_3b6fbc2f-6e7d-447e-a117-2437a8787a37/init-textfile/0.log"
Jul 11 01:58:34.207782 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.207698    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ggnhm_2e1a77b7-7cac-44cf-8243-2ac540ff8bc1/prometheus-operator/0.log"
Jul 11 01:58:34.232482 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.232448    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ggnhm_2e1a77b7-7cac-44cf-8243-2ac540ff8bc1/kube-rbac-proxy/0.log"
Jul 11 01:58:34.256756 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.256729    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-kgl8x_d3c1f703-a51e-47ef-a974-1723ce374d70/prometheus-operator-admission-webhook/0.log"
Jul 11 01:58:34.393107 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.393076    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf5f7967f-4smsz_d5648ec6-a20a-4bb5-8686-dcd8e323812b/thanos-query/0.log"
Jul 11 01:58:34.417678 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.417652    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf5f7967f-4smsz_d5648ec6-a20a-4bb5-8686-dcd8e323812b/kube-rbac-proxy-web/0.log"
Jul 11 01:58:34.439687 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.439663    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf5f7967f-4smsz_d5648ec6-a20a-4bb5-8686-dcd8e323812b/kube-rbac-proxy/0.log"
Jul 11 01:58:34.463957 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.463900    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf5f7967f-4smsz_d5648ec6-a20a-4bb5-8686-dcd8e323812b/prom-label-proxy/0.log"
Jul 11 01:58:34.484304 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.484274    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf5f7967f-4smsz_d5648ec6-a20a-4bb5-8686-dcd8e323812b/kube-rbac-proxy-rules/0.log"
Jul 11 01:58:34.504576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:34.504553    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cf5f7967f-4smsz_d5648ec6-a20a-4bb5-8686-dcd8e323812b/kube-rbac-proxy-metrics/0.log"
Jul 11 01:58:37.196100 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.196064    2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"]
Jul 11 01:58:37.196591 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.196568    2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3705c10-1d56-4b92-98e2-177037359014" containerName="revoke-keys"
Jul 11 01:58:37.196591 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.196583    2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3705c10-1d56-4b92-98e2-177037359014" containerName="revoke-keys"
Jul 11 01:58:37.196662 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.196652    2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3705c10-1d56-4b92-98e2-177037359014" containerName="revoke-keys"
Jul 11 01:58:37.199946 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.199929    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.202814 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.202785    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hqjb\"/\"openshift-service-ca.crt\""
Jul 11 01:58:37.203832 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.203815    2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6hqjb\"/\"default-dockercfg-j7bpp\""
Jul 11 01:58:37.203917 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.203844    2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hqjb\"/\"kube-root-ca.crt\""
Jul 11 01:58:37.210113 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.210086    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"]
Jul 11 01:58:37.279343 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.279303    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-podres\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.279518 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.279359    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-lib-modules\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.279518 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.279432    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-sys\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.279518 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.279463    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-proc\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.279518 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.279510    2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4f8w\" (UniqueName: \"kubernetes.io/projected/f5ae4971-735c-4f07-81ba-3fc97c954c2f-kube-api-access-c4f8w\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380450 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380415    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-podres\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380463    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-lib-modules\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380500    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-sys\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380520    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-proc\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380576    2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4f8w\" (UniqueName: \"kubernetes.io/projected/f5ae4971-735c-4f07-81ba-3fc97c954c2f-kube-api-access-c4f8w\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380593    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-podres\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380613    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-sys\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380654 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380649    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-lib-modules\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.380915 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.380668    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f5ae4971-735c-4f07-81ba-3fc97c954c2f-proc\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.387971 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.387940    2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4f8w\" (UniqueName: \"kubernetes.io/projected/f5ae4971-735c-4f07-81ba-3fc97c954c2f-kube-api-access-c4f8w\") pod \"perf-node-gather-daemonset-5scnq\" (UID: \"f5ae4971-735c-4f07-81ba-3fc97c954c2f\") " pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.511262 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.511159    2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:37.642529 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.642502    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-x5wrb_2ec39d17-a3ab-4384-9b16-aff7902566bf/volume-data-source-validator/0.log"
Jul 11 01:58:37.648502 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:37.648483    2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"]
Jul 11 01:58:37.649634 ip-10-0-139-236 kubenswrapper[2555]: W0711 01:58:37.649610    2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5ae4971_735c_4f07_81ba_3fc97c954c2f.slice/crio-3a79591527a7f5760b300354ae7f98234674ff91ca308f46f7563f993bda7102 WatchSource:0}: Error finding container 3a79591527a7f5760b300354ae7f98234674ff91ca308f46f7563f993bda7102: Status 404 returned error can't find the container with id 3a79591527a7f5760b300354ae7f98234674ff91ca308f46f7563f993bda7102
Jul 11 01:58:38.105766 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.105727    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq" event={"ID":"f5ae4971-735c-4f07-81ba-3fc97c954c2f","Type":"ContainerStarted","Data":"a4ef4d76771125c1be1dbaeb885e24c9e412752a7c18bbadf97d3eb33c0f7772"}
Jul 11 01:58:38.106001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.105784    2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq" event={"ID":"f5ae4971-735c-4f07-81ba-3fc97c954c2f","Type":"ContainerStarted","Data":"3a79591527a7f5760b300354ae7f98234674ff91ca308f46f7563f993bda7102"}
Jul 11 01:58:38.106001 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.105839    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:38.121559 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.121507    2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq" podStartSLOduration=1.121489955 podStartE2EDuration="1.121489955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 01:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 01:58:38.120870969 +0000 UTC m=+3140.987839519" watchObservedRunningTime="2026-07-11 01:58:38.121489955 +0000 UTC m=+3140.988458549"
Jul 11 01:58:38.692421 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.692391    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rdxnw_f6fa1db6-107a-4ea2-93dc-11350c248b46/dns/0.log"
Jul 11 01:58:38.714041 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.714014    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rdxnw_f6fa1db6-107a-4ea2-93dc-11350c248b46/kube-rbac-proxy/0.log"
Jul 11 01:58:38.776491 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:38.776468    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zx5m_fdbe7db2-a00e-4468-9a3b-51ec7a46ebe2/dns-node-resolver/0.log"
Jul 11 01:58:39.388672 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:39.388596    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8dffl_a6d4c38a-21a1-4dc1-b8cb-c38e2c3ab64d/node-ca/0.log"
Jul 11 01:58:40.445639 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:40.445611    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-56wjm_9cdfd765-5040-4995-927f-d8600edf8a8d/kube-auth-proxy/0.log"
Jul 11 01:58:40.534982 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:40.534951    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qrm2j_eda7919e-1048-45b4-b8cb-8f75a2f0c4bc/payload-pre-processing/0.log"
Jul 11 01:58:40.564466 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:40.564437    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-2g597_7b20d699-5da3-4d25-b514-e25b8a8d9c0d/payload-processing/0.log"
Jul 11 01:58:40.586599 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:40.586574    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4b6c4b64-bdp2p_c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb/router/0.log"
Jul 11 01:58:41.316006 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:41.315978    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qn7nx_0daca65b-a30d-4a91-a9e9-2afa12766d2e/serve-healthcheck-canary/0.log"
Jul 11 01:58:41.764580 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:41.764490    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ktqfz_11719803-2ed2-4d47-b2dd-acfdd82c7451/insights-operator/0.log"
Jul 11 01:58:41.765056 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:41.765036    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ktqfz_11719803-2ed2-4d47-b2dd-acfdd82c7451/insights-operator/1.log"
Jul 11 01:58:41.788767 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:41.788740    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8j5zc_6e524e49-f563-4713-b940-8b0c7292cfaf/kube-rbac-proxy/0.log"
Jul 11 01:58:41.810576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:41.810551    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8j5zc_6e524e49-f563-4713-b940-8b0c7292cfaf/exporter/0.log"
Jul 11 01:58:41.832024 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:41.832002    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8j5zc_6e524e49-f563-4713-b940-8b0c7292cfaf/extractor/0.log"
Jul 11 01:58:44.093316 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.093288    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zdlfx_de8cd025-87a0-4c49-bf64-23b855c0f542/manager/0.log"
Jul 11 01:58:44.122970 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.122947    2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6hqjb/perf-node-gather-daemonset-5scnq"
Jul 11 01:58:44.229576 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.229546    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m6t6n_0a291201-6be2-4356-80fa-1991a6a7b377/manager/0.log"
Jul 11 01:58:44.332806 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.332772    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-558bfbff58-m2rxb_35ad9b2e-9a27-45ab-8b6b-766957c41b76/manager/0.log"
Jul 11 01:58:44.351896 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.351822    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkl4l_70e3472a-885d-4608-9a5a-1f0769640af2/server/0.log"
Jul 11 01:58:44.415715 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.415689    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kfvn6_6a2dd919-8714-4b98-9e55-26e28e7cca13/manager/0.log"
Jul 11 01:58:44.487425 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.487392    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-m9445_1add6ff3-1f90-47d2-a702-0819c34b0667/manager/0.log"
Jul 11 01:58:44.504870 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:44.504847    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fcd49758-m9445_1add6ff3-1f90-47d2-a702-0819c34b0667/copy-manifests/0.log"
Jul 11 01:58:45.784908 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:45.784877    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5dr5v_7892b3f6-f1eb-40de-9dc8-c34aea483865/openshift-lws-operator/0.log"
Jul 11 01:58:47.386604 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:47.386575    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-56wjm_9cdfd765-5040-4995-927f-d8600edf8a8d/kube-auth-proxy/0.log"
Jul 11 01:58:47.454131 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:47.454105    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qrm2j_eda7919e-1048-45b4-b8cb-8f75a2f0c4bc/payload-pre-processing/0.log"
Jul 11 01:58:47.473089 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:47.473065    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-2g597_7b20d699-5da3-4d25-b514-e25b8a8d9c0d/payload-processing/0.log"
Jul 11 01:58:47.485589 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:47.485569    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4b6c4b64-bdp2p_c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb/router/0.log"
Jul 11 01:58:48.897259 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:48.897227    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dcd4c987-56wjm_9cdfd765-5040-4995-927f-d8600edf8a8d/kube-auth-proxy/0.log"
Jul 11 01:58:48.975040 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:48.975013    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qrm2j_eda7919e-1048-45b4-b8cb-8f75a2f0c4bc/payload-pre-processing/0.log"
Jul 11 01:58:48.995072 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:48.995028    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-2g597_7b20d699-5da3-4d25-b514-e25b8a8d9c0d/payload-processing/0.log"
Jul 11 01:58:49.008415 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:49.008394    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b4b6c4b64-bdp2p_c6975d9f-2bf4-46b8-8e1c-c3a4406d0cdb/router/0.log"
Jul 11 01:58:52.322050 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.322019    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/kube-multus-additional-cni-plugins/0.log"
Jul 11 01:58:52.342019 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.341994    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/egress-router-binary-copy/0.log"
Jul 11 01:58:52.361899 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.361873    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/cni-plugins/0.log"
Jul 11 01:58:52.386252 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.386226    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/bond-cni-plugin/0.log"
Jul 11 01:58:52.405136 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.405111    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/routeoverride-cni/0.log"
Jul 11 01:58:52.423362 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.423339    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/whereabouts-cni-bincopy/0.log"
Jul 11 01:58:52.443273 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.443251    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bbrn7_e12b4b3b-324b-4e91-bf03-321700bce576/whereabouts-cni/0.log"
Jul 11 01:58:52.779770 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.779747    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mxzsx_bf9ea35b-70db-4270-bb64-edd93042f199/kube-multus/0.log"
Jul 11 01:58:52.891916 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.891885    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rltd_69707e06-c807-4a84-97ad-92925e8f1656/network-metrics-daemon/0.log"
Jul 11 01:58:52.909982 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:52.909955    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rltd_69707e06-c807-4a84-97ad-92925e8f1656/kube-rbac-proxy/0.log"
Jul 11 01:58:53.741124 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.741045    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-controller/0.log"
Jul 11 01:58:53.759157 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.759117    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/1.log"
Jul 11 01:58:53.759336 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.759174    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovn-acl-logging/0.log"
Jul 11 01:58:53.780835 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.780793    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/kube-rbac-proxy-node/0.log"
Jul 11 01:58:53.801316 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.801293    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/kube-rbac-proxy-ovn-metrics/0.log"
Jul 11 01:58:53.820855 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.820837    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/northd/0.log"
Jul 11 01:58:53.840681 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.840644    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/nbdb/0.log"
Jul 11 01:58:53.860620 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.860599    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/sbdb/0.log"
Jul 11 01:58:53.914771 ip-10-0-139-236 kubenswrapper[2555]: I0711 01:58:53.914743    2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9crv6_7967365b-2032-4423-b322-77b5d99bddfb/ovnkube-controller/0.log"