Jul 02 19:54:56.481376 ip-10-0-136-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 19:54:56.481390 ip-10-0-136-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 19:54:56.481398 ip-10-0-136-8 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 19:54:56.481698 ip-10-0-136-8 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 19:55:06.525107 ip-10-0-136-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 19:55:06.525127 ip-10-0-136-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 281be5918be9411a8d74cb0787197656 -- Jul 02 19:56:45.140162 ip-10-0-136-8 systemd[1]: Starting Kubernetes Kubelet... Jul 02 19:56:45.619587 ip-10-0-136-8 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:56:45.619587 ip-10-0-136-8 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 19:56:45.619587 ip-10-0-136-8 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:56:45.619587 ip-10-0-136-8 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 19:56:45.619587 ip-10-0-136-8 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:56:45.619587 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.614537 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620608 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620624 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620629 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620634 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620637 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620639 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620642 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620645 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620648 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620651 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620653 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620656 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620659 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620661 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620670 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620673 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620677 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620679 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:56:45.635847 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620682 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620684 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620687 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620690 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620693 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620697 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620701 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620704 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620707 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620710 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620713 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620716 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620718 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620721 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620724 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620727 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620729 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620732 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620734 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:56:45.649962 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620737 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620740 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620742 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620745 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620747 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620750 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620752 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620755 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620757 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620760 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620763 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620766 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620768 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620770 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620773 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620775 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620778 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620781 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620784 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620786 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:56:45.652241 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620789 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620792 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620794 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620798 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620800 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620804 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620807 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620810 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620812 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620815 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620817 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620820 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620822 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620825 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620827 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620830 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620833 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620836 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620838 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620841 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:56:45.654072 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620843 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620846 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620849 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620852 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620855 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620857 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620860 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620862 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620865 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620867 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620871 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620900 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620903 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620906 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620909 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620911 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620914 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620917 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620919 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:56:45.656383 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620922 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620927 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.620930 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621622 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621629 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621632 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621634 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621637 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621640 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621642 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621645 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621647 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621650 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621653 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621655 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621659 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621663 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621666 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621669 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:56:45.670102 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621672 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621675 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621677 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621680 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621683 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621685 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621688 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621691 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621693 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621696 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621698 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621702 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621704 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621707 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621709 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621712 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621714 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621716 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621719 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:56:45.672798 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621721 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621724 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621726 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621729 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621731 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621734 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621736 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621738 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621741 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621744 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621746 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621748 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621751 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621754 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621756 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621759 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621761 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621764 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621768 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:56:45.674552 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621771 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621774 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621777 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621780 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621785 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621787 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621790 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621793 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621795 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621800 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621803 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621805 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621808 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621810 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621813 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621817 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621821 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621823 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621826 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621828 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:56:45.676831 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621831 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621833 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621837 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621840 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621843 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621845 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621852 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621855 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621857 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621860 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621862 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621865 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621867 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621870 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621888 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621891 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621896 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621899 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621901 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621904 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:56:45.755442 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621906 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621910 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621913 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621915 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.621918 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622361 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622368 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622371 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622374 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622377 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622380 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622383 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622385 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622388 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622391 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622393 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622395 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622398 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622401 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622404 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:56:45.798603 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622406 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:56:45.694613 ip-10-0-136-8 systemd[1]: Started Kubernetes Kubelet. Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622409 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622411 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622414 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622416 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622419 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622421 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622424 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622428 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622431 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622433 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622436 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622438 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622442 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622444 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622447 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622449 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622452 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622454 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:56:45.940493 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622457 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622460 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622462 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622465 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622467 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622470 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622473 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622475 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622478 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622480 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622485 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622488 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622491 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622494 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622497 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622499 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622502 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622505 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622507 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622509 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:56:45.941244 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622512 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622516 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622518 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622521 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622523 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622525 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622529 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622531 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622534 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622536 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622539 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622541 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622544 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622546 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622549 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622551 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622554 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622556 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622559 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:56:45.941844 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622561 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622563 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622567 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622570 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622572 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622574 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622577 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622579 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622582 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622584 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622587 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622589 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622592 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622594 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622598 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622601 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622603 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622606 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622608 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622612 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:56:45.942477 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622614 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622617 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622619 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622623 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622626 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.622630 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622710 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622717 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622723 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622728 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622733 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622738 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622744 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622751 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622755 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622760 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622763 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622767 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622770 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622774 2555 flags.go:64] FLAG: --cgroup-root="" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622778 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622781 2555 flags.go:64] FLAG: --client-ca-file="" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622783 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 02 19:56:45.943080 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622786 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622790 2555 flags.go:64] FLAG: --cluster-domain="" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622793 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622797 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622800 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622803 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622807 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622810 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622815 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622818 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622821 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622824 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622827 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622830 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622833 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622837 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622840 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622843 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622845 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622848 2555 flags.go:64] FLAG: --enable-server="true" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622851 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622855 2555 flags.go:64] FLAG: --event-burst="100" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622858 2555 flags.go:64] FLAG: --event-qps="50" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622861 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 19:56:45.943784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622864 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622867 2555 flags.go:64] FLAG: --eviction-hard="" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622871 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622888 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622891 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622894 2555 flags.go:64] FLAG: --eviction-soft="" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622897 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622900 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622903 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622906 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622909 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622913 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622916 2555 flags.go:64] FLAG: --feature-gates="" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622920 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622923 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622926 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622930 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622933 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622936 2555 flags.go:64] FLAG: --help="false" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622939 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-136-8.ec2.internal" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622942 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622945 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622948 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622951 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 19:56:45.944469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622955 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622958 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622961 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622963 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622966 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622969 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622972 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622975 2555 flags.go:64] FLAG: --kube-reserved="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622978 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622980 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622983 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622986 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622989 2555 flags.go:64] FLAG: --lock-file="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622991 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622995 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.622998 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623003 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623006 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623009 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623012 2555 flags.go:64] FLAG: --logging-format="text" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623015 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623018 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623021 2555 flags.go:64] FLAG: --manifest-url="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623024 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623031 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 19:56:45.945273 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623034 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623043 2555 flags.go:64] FLAG: --max-pods="110" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623046 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623048 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623051 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623054 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623057 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623068 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623071 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623078 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623081 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623084 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623087 2555 flags.go:64] FLAG: --pod-cidr="" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623090 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623095 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623098 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623101 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623104 2555 flags.go:64] FLAG: --port="10250" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623107 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623110 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e17c74f887341205" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623113 2555 flags.go:64] FLAG: --qos-reserved="" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623116 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623120 2555 flags.go:64] FLAG: --register-node="true" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623123 2555 flags.go:64] FLAG: --register-with-taints="" Jul 02 19:56:45.946002 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623126 2555 flags.go:64] FLAG: --registry-burst="10" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623129 2555 flags.go:64] FLAG: --registry-qps="5" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623134 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623136 2555 flags.go:64] FLAG: --reserved-memory="" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623140 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623143 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623146 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623149 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623153 2555 flags.go:64] FLAG: --runonce="false" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623156 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623159 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623162 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623165 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623168 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623171 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623174 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623177 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623180 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623183 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623186 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623188 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623191 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623194 2555 flags.go:64] FLAG: --system-cgroups="" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623197 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623202 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 19:56:45.946817 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623205 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623208 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623211 2555 flags.go:64] FLAG: --tls-min-version="" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623214 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623216 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623219 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623223 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623225 2555 flags.go:64] FLAG: --v="2" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623229 2555 flags.go:64] FLAG: --version="false" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623234 2555 flags.go:64] FLAG: --vmodule="" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623239 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.623242 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623363 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623366 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623370 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623374 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623377 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623381 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623384 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623387 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623391 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623394 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:56:45.947553 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623397 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623399 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623402 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623404 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623407 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623409 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623412 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623414 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623417 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623421 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623424 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623426 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623429 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623432 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623434 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623437 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623440 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623443 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623445 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:56:45.948238 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623449 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623451 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623454 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623456 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623459 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623461 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623465 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623467 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623470 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623472 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623475 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623477 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623480 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623482 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623485 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623487 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623490 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623493 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623495 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623499 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:56:45.948767 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623502 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623505 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623507 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623510 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623513 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623515 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623518 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623520 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623523 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623526 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623528 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623532 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623535 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623538 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623540 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623543 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623546 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623548 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623552 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:56:45.949594 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623555 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623557 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623560 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623562 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623565 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623567 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623570 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623572 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623575 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623577 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623580 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623583 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623585 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623588 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623590 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623593 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623595 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623598 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623600 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623603 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:56:45.950272 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623605 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623608 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623610 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623613 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623615 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623621 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623623 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623626 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623629 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623631 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.623634 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.624164 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.632108 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.632125 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.632143 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 19:56:45.950911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.632149 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632206 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632212 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632217 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632221 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632225 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632228 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632230 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632233 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632236 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632239 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632242 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632244 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632247 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632250 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632253 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632256 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632258 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632261 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632264 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:56:45.951532 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632266 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632270 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632276 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632279 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632282 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632285 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632287 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632290 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632293 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632296 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632298 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632301 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632304 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632306 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632309 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632311 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632314 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632316 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632319 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632322 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:56:45.952218 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632326 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632329 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632332 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632334 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632337 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632343 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632345 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632348 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632352 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632355 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632358 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632360 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632363 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632366 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632368 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632371 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632374 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632377 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632379 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632382 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632384 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:56:45.952773 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632387 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632391 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632394 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632397 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632399 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632402 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632405 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632407 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632410 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632412 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632415 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632417 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632420 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632423 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632425 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632427 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632432 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632434 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632437 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:56:45.953580 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632444 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632447 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632449 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632452 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632454 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632457 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632459 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632462 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632464 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632467 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632469 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632472 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632475 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632477 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632480 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632482 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632486 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632489 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632493 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:56:46.103270 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632496 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.632501 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632621 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632626 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632629 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632632 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632635 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632637 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632640 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632643 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632645 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632649 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632652 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632656 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632659 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:56:46.104095 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632662 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632664 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632667 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632670 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632672 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632675 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632677 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632680 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632683 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632685 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632688 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632690 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632693 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632695 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632698 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632700 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632703 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632705 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632708 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632710 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:56:46.106662 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632713 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632715 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632718 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632720 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632722 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632725 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632727 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632730 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632733 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632736 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632740 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632742 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632746 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632750 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632754 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632757 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632760 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632762 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632765 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632768 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:56:46.107264 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632771 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632775 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632778 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632781 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632784 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632786 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632789 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632792 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632795 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632798 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632801 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632803 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632806 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632809 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632812 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632814 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632817 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632820 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632823 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632825 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:56:46.107792 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632829 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632832 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632836 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632839 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632842 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632845 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632847 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632850 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632852 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632855 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632858 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632860 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632863 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632866 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632868 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632871 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632917 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632928 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632939 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632942 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:56:46.108413 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632945 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632948 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632952 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632956 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632960 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:45.632963 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.632969 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.633094 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.636689 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.638283 2555 server.go:1019] "Starting client certificate rotation" Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.638382 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.638408 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:56:46.108970 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.641099 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.646548 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.660582 2555 log.go:25] "Validated CRI v1 runtime API" Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.663950 2555 log.go:25] "Validated CRI v1 image API" Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.664800 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.667179 2555 fs.go:135] Filesystem UUIDs: map[052001eb-44c9-43e6-bec4-c6c266324863:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a4bf5fd0-4d01-427e-b874-e4a8cd6a966e:/dev/nvme0n1p3] Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.667193 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 19:56:46.109356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.669906 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.673564 2555 manager.go:216] Machine: {Timestamp:2026-07-02 19:56:45.671373121 +0000 UTC m=+0.401815519 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101527 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2c195e4f9ffcb317d7f040b4b062 SystemUUID:ec2f2c19-5e4f-9ffc-b317-d7f040b4b062 BootID:281be591-8be9-411a-8d74-cb0787197656 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:ba:93:2a:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:ba:93:2a:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:c6:b7:9d:03:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.673664 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.673743 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.677654 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.677675 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.678923 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.678945 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.678956 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.678990 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.680510 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683449 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683562 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683589 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683598 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683609 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683617 2555 kubelet.go:398] "Adding apiserver pod source" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.683626 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 19:56:46.109650 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.684006 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.684032 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.686191 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.688402 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.688429 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689550 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689567 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689574 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689589 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689601 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689609 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689620 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689629 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689638 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689646 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689657 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.689665 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.690438 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.690448 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.691988 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfm64" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.693956 2555 server.go:1268] "Started kubelet" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.694038 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.694068 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.694098 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.695839 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.695951 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.696295 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.696452 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.696572 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.699336 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.700210 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfm64" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.700801 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.700820 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.700932 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.701456 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.701456 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.701477 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.701586 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.701597 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702013 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702039 2555 factory.go:55] Registering systemd factory Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702049 2555 factory.go:223] Registration of the systemd container factory successfully Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702268 2555 factory.go:153] Registering CRI-O factory Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702283 2555 factory.go:223] Registration of the crio container factory successfully Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702300 2555 factory.go:103] Registering Raw factory Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702316 2555 manager.go:1196] Started watching for new ooms in manager Jul 02 19:56:46.239721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.702871 2555 manager.go:349] Starting recovery of all containers Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.701937 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-8.ec2.internal.18be913fcd028eaf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-8.ec2.internal,UID:ip-10-0-136-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-8.ec2.internal,},FirstTimestamp:2026-07-02 19:56:45.693759151 +0000 UTC m=+0.424201547,LastTimestamp:2026-07-02 19:56:45.693759151 +0000 UTC m=+0.424201547,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-8.ec2.internal,}" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.712672 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.715856 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-8.ec2.internal\" not found" node="ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.717359 2555 manager.go:354] Recovery completed Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.721262 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.722988 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.723012 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.723022 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.723680 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.723692 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.723711 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.723694 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.724492 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.724518 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.724528 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.724743 2555 policy_none.go:49] "None policy: Start" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.724756 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.724768 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.725779 2555 policy_none.go:47] "Start" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.801748 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.807549 2555 manager.go:337] "Starting Device Plugin manager" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.807610 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.807623 2555 server.go:87] "Starting device plugin registration server" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.807895 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.807913 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.808048 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.808126 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.808136 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.808648 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.808713 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.864667 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.865922 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.865963 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.866003 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.866041 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.868313 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.908430 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.909427 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.909455 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.909465 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.909496 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.241110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.918540 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.918560 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-8.ec2.internal\": node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.946808 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.966848 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal"] Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.966934 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.968366 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.968387 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.968399 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.969652 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.969835 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.969866 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.970638 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.970657 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.970670 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.970906 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.970920 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.970932 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.972032 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.972056 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.977159 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.977178 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:45.977189 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:45.995381 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-8.ec2.internal\" not found" node="ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.001157 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-8.ec2.internal\" not found" node="ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.003280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca5057edadbcb38ff03c062e950e5d3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-8.ec2.internal\" (UID: \"2ca5057edadbcb38ff03c062e950e5d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.003306 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4452d912d9fcd2a9c82fa6d78e5f4634-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"4452d912d9fcd2a9c82fa6d78e5f4634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.003332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4452d912d9fcd2a9c82fa6d78e5f4634-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"4452d912d9fcd2a9c82fa6d78e5f4634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.047622 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.104088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca5057edadbcb38ff03c062e950e5d3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-8.ec2.internal\" (UID: \"2ca5057edadbcb38ff03c062e950e5d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.242378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.104115 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4452d912d9fcd2a9c82fa6d78e5f4634-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"4452d912d9fcd2a9c82fa6d78e5f4634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.243217 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.104137 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4452d912d9fcd2a9c82fa6d78e5f4634-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"4452d912d9fcd2a9c82fa6d78e5f4634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.243217 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.104162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4452d912d9fcd2a9c82fa6d78e5f4634-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"4452d912d9fcd2a9c82fa6d78e5f4634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.243217 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.104190 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca5057edadbcb38ff03c062e950e5d3-config\") pod \"kube-apiserver-proxy-ip-10-0-136-8.ec2.internal\" (UID: \"2ca5057edadbcb38ff03c062e950e5d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.243217 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.104202 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4452d912d9fcd2a9c82fa6d78e5f4634-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal\" (UID: \"4452d912d9fcd2a9c82fa6d78e5f4634\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.243217 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.147673 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.330887 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.248195 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.330887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.298296 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.330887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.304893 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" Jul 02 19:56:46.534820 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.348764 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.534820 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.449186 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.549682 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.637804 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.637972 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.637979 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.649898 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.704852 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:51:45 +0000 UTC" deadline="2028-02-07 13:03:47.912159139 +0000 UTC" Jul 02 19:56:46.712887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.704900 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14033h7m1.207261103s" Jul 02 19:56:46.866034 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:46.750126 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-8.ec2.internal\" not found" Jul 02 19:56:46.866034 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.829761 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:46.900275 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4452d912d9fcd2a9c82fa6d78e5f4634.slice/crio-dab509e96ef27872da6162815bf42f967b8083718e032799c4747fc283606f60 WatchSource:0}: Error finding container dab509e96ef27872da6162815bf42f967b8083718e032799c4747fc283606f60: Status 404 returned error can't find the container with id dab509e96ef27872da6162815bf42f967b8083718e032799c4747fc283606f60 Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:46.900515 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca5057edadbcb38ff03c062e950e5d3.slice/crio-0a6b7273ece235f58fc8f40cca8e64dbb52a910f2adfaca5e45e62bd32e64904 WatchSource:0}: Error finding container 0a6b7273ece235f58fc8f40cca8e64dbb52a910f2adfaca5e45e62bd32e64904: Status 404 returned error can't find the container with id 0a6b7273ece235f58fc8f40cca8e64dbb52a910f2adfaca5e45e62bd32e64904 Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.901641 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.909581 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.912251 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.914471 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" Jul 02 19:56:47.064366 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:46.925963 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:56:47.243787 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.172398 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:56:47.546252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.535752 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.684339 2555 apiserver.go:52] "Watching apiserver" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.692260 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.692734 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-d94cr","openshift-network-operator/iptables-alerter-gwsfj","openshift-ovn-kubernetes/ovnkube-node-xwmpf","kube-system/konnectivity-agent-gjc8h","kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r","openshift-cluster-node-tuning-operator/tuned-7qrsx","openshift-dns/node-resolver-2b2wp","openshift-image-registry/node-ca-mwr9d","openshift-multus/multus-additional-cni-plugins-dhj4r","openshift-multus/network-metrics-daemon-bpw2q","kube-system/global-pull-secret-syncer-ts6nm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal","openshift-multus/multus-v87ct"] Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.694336 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.695792 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.697230 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h7gq8\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.697546 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.699108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.699329 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jvkq9\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.699327 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.699369 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.699463 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.699810 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.701032 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.701587 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.701606 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zp5gp\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.702044 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.702100 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.702837 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.702913 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.702986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.703365 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pfq72\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.703525 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.704359 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.704715 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.704800 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.706458 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.708114 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.708785 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.708860 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.709150 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.709237 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94lgd\"" Jul 02 19:56:47.730372 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.710018 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.710697 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.710765 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.710813 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.710905 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rq8fb\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.712096 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.712139 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.713091 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.713402 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fcrzp\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.714064 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.714128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.714778 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.714902 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-run\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-tmp-dir\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-ovn\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovnkube-script-lib\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715219 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysconfig\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-kubernetes\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysctl-conf\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715154 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-etc-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-log-socket\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.733518 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.715389 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715393 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-cni-bin\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-env-overrides\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54440b1f-4ae0-4ada-a96c-449cb170b854-tmp\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-systemd\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-lib-modules\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715540 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-var-lib-kubelet\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715563 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-slash\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-systemd\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzfp\" (UniqueName: \"kubernetes.io/projected/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-kube-api-access-9wzfp\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715649 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7pg77\"" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54df8714-3929-4d8e-ae6f-75e04f6f266a-konnectivity-ca\") pod \"konnectivity-agent-gjc8h\" (UID: \"54df8714-3929-4d8e-ae6f-75e04f6f266a\") " pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715712 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715743 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54df8714-3929-4d8e-ae6f-75e04f6f266a-agent-certs\") pod \"konnectivity-agent-gjc8h\" (UID: \"54df8714-3929-4d8e-ae6f-75e04f6f266a\") " pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715752 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-kubelet\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715793 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-run-netns\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715819 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:56:47.734894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715871 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysctl-d\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-sys\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-node-log\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.715982 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716008 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-modprobe-d\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmnbm\" (UniqueName: \"kubernetes.io/projected/54440b1f-4ae0-4ada-a96c-449cb170b854-kube-api-access-gmnbm\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-var-lib-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-cni-netd\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovnkube-config\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovn-node-metrics-cert\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-host\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-tuned\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716244 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-hosts-file\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsnhr\" (UniqueName: \"kubernetes.io/projected/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-kube-api-access-dsnhr\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-systemd-units\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.736964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716528 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:47.738383 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.716588 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:47.738383 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716749 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rcstz\"" Jul 02 19:56:47.738383 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716820 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 19:56:47.738383 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.716983 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 19:56:47.751162 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.748564 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9tlc" Jul 02 19:56:47.816700 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.758997 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9tlc" Jul 02 19:56:47.816700 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.803505 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 19:56:47.817718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-etc-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.817718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817595 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-log-socket\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.817718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-device-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.817718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817677 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgkk\" (UniqueName: \"kubernetes.io/projected/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-kube-api-access-lpgkk\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.817718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf756\" (UniqueName: \"kubernetes.io/projected/6d335f2e-9978-4088-ad57-c429506e14e0-kube-api-access-bf756\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817738 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-registration-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj82q\" (UniqueName: \"kubernetes.io/projected/0969172f-4528-4a90-8628-1121113343ff-kube-api-access-mj82q\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-os-release\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817840 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d325dfc6-0226-40f2-91bd-6ec23f095948-dbus\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-slash\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817922 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-systemd\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.817975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzfp\" (UniqueName: \"kubernetes.io/projected/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-kube-api-access-9wzfp\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54df8714-3929-4d8e-ae6f-75e04f6f266a-konnectivity-ca\") pod \"konnectivity-agent-gjc8h\" (UID: \"54df8714-3929-4d8e-ae6f-75e04f6f266a\") " pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54df8714-3929-4d8e-ae6f-75e04f6f266a-agent-certs\") pod \"konnectivity-agent-gjc8h\" (UID: \"54df8714-3929-4d8e-ae6f-75e04f6f266a\") " pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-kubelet\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-run-netns\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.818291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysctl-d\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818306 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0969172f-4528-4a90-8628-1121113343ff-host\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-system-cni-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-node-log\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-modprobe-d\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-cni-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818520 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-conf-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-cnibin\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-var-lib-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818614 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-cni-netd\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-host\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818680 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-tuned\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-sys-fs\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-hosts-file\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsnhr\" (UniqueName: \"kubernetes.io/projected/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-kube-api-access-dsnhr\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-run\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.819760 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818869 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-socket-dir-parent\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-kubelet\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.818979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-multus-certs\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819023 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-tmp-dir\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-ovn\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovnkube-script-lib\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysconfig\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819167 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-kubernetes\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819200 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysctl-conf\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819229 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-netns\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-cni-bin\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-env-overrides\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54440b1f-4ae0-4ada-a96c-449cb170b854-tmp\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-cni-multus\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-daemon-config\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819487 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-systemd\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.820762 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819522 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-lib-modules\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-var-lib-kubelet\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-hostroot\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8svxf\" (UniqueName: \"kubernetes.io/projected/60e47115-227f-4d5d-85f9-0fca6f022b96-kube-api-access-8svxf\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-os-release\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819697 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-sys\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819768 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-cni-binary-copy\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819838 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-system-cni-dir\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819876 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmnbm\" (UniqueName: \"kubernetes.io/projected/54440b1f-4ae0-4ada-a96c-449cb170b854-kube-api-access-gmnbm\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-857bm\" (UniqueName: \"kubernetes.io/projected/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-kube-api-access-857bm\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.819944 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60e47115-227f-4d5d-85f9-0fca6f022b96-iptables-alerter-script\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820198 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/54df8714-3929-4d8e-ae6f-75e04f6f266a-konnectivity-ca\") pod \"konnectivity-agent-gjc8h\" (UID: \"54df8714-3929-4d8e-ae6f-75e04f6f266a\") " pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820502 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-kubelet\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60e47115-227f-4d5d-85f9-0fca6f022b96-host-slash\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.822032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820588 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovnkube-config\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820668 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovn-node-metrics-cert\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0969172f-4528-4a90-8628-1121113343ff-serviceca\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820719 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-etc-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820748 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d325dfc6-0226-40f2-91bd-6ec23f095948-kubelet-config\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820786 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-systemd-units\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820824 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-socket-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-cnibin\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820900 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-k8s-cni-cncf-io\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820951 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-run-netns\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820942 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-etc-kubernetes\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.820784 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-log-socket\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821130 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-slash\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821169 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-ovn\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.823173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-systemd-units\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821198 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8mdl\" (UniqueName: \"kubernetes.io/projected/a81c0c79-f53e-447f-a398-edacfb3dc77b-kube-api-access-w8mdl\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821249 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821261 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-var-lib-openvswitch\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821340 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-kubernetes\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-modprobe-d\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821368 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysconfig\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821376 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-cni-netd\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821402 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-host\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821456 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysctl-d\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-run\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-cni-bin\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821664 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-run-systemd\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.821779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822093 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-tmp-dir\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.824400 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822200 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-hosts-file\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovnkube-config\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovnkube-script-lib\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822642 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-node-log\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-host-cni-bin\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822851 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-sysctl-conf\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.822974 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-lib-modules\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.823024 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-systemd\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.823091 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-var-lib-kubelet\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.823637 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54440b1f-4ae0-4ada-a96c-449cb170b854-sys\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.825483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.824156 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-env-overrides\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.826648 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54440b1f-4ae0-4ada-a96c-449cb170b854-tmp\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.826899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-ovn-node-metrics-cert\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.827225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/54440b1f-4ae0-4ada-a96c-449cb170b854-etc-tuned\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.827460 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.827482 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.827496 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.827580 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:56:48.327551667 +0000 UTC m=+3.057994076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.829554 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/54df8714-3929-4d8e-ae6f-75e04f6f266a-agent-certs\") pod \"konnectivity-agent-gjc8h\" (UID: \"54df8714-3929-4d8e-ae6f-75e04f6f266a\") " pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.832745 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmnbm\" (UniqueName: \"kubernetes.io/projected/54440b1f-4ae0-4ada-a96c-449cb170b854-kube-api-access-gmnbm\") pod \"tuned-7qrsx\" (UID: \"54440b1f-4ae0-4ada-a96c-449cb170b854\") " pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.833474 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzfp\" (UniqueName: \"kubernetes.io/projected/e253eedb-7b33-4e2a-b532-e0ac3a0545f8-kube-api-access-9wzfp\") pod \"ovnkube-node-xwmpf\" (UID: \"e253eedb-7b33-4e2a-b532-e0ac3a0545f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.875608 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" event={"ID":"2ca5057edadbcb38ff03c062e950e5d3","Type":"ContainerStarted","Data":"0a6b7273ece235f58fc8f40cca8e64dbb52a910f2adfaca5e45e62bd32e64904"} Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.877998 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" event={"ID":"4452d912d9fcd2a9c82fa6d78e5f4634","Type":"ContainerStarted","Data":"dab509e96ef27872da6162815bf42f967b8083718e032799c4747fc283606f60"} Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.886633 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsnhr\" (UniqueName: \"kubernetes.io/projected/2151aa60-2c27-44f9-827f-3ad2ecbdc6f7-kube-api-access-dsnhr\") pod \"node-resolver-2b2wp\" (UID: \"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7\") " pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:47.902166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.891869 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-cni-multus\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-daemon-config\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-hostroot\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-cni-multus\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8svxf\" (UniqueName: \"kubernetes.io/projected/60e47115-227f-4d5d-85f9-0fca6f022b96-kube-api-access-8svxf\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923245 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-os-release\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923261 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-hostroot\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-cni-binary-copy\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-system-cni-dir\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-857bm\" (UniqueName: \"kubernetes.io/projected/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-kube-api-access-857bm\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60e47115-227f-4d5d-85f9-0fca6f022b96-iptables-alerter-script\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923426 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60e47115-227f-4d5d-85f9-0fca6f022b96-host-slash\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923452 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923479 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0969172f-4528-4a90-8628-1121113343ff-serviceca\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:47.976566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923529 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d325dfc6-0226-40f2-91bd-6ec23f095948-kubelet-config\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923531 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-system-cni-dir\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-socket-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923581 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-cnibin\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923607 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-k8s-cni-cncf-io\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-os-release\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923632 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-etc-kubernetes\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8mdl\" (UniqueName: \"kubernetes.io/projected/a81c0c79-f53e-447f-a398-edacfb3dc77b-kube-api-access-w8mdl\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923710 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-cni-bin\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923777 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-daemon-config\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-device-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgkk\" (UniqueName: \"kubernetes.io/projected/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-kube-api-access-lpgkk\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf756\" (UniqueName: \"kubernetes.io/projected/6d335f2e-9978-4088-ad57-c429506e14e0-kube-api-access-bf756\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-registration-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.062429 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj82q\" (UniqueName: \"kubernetes.io/projected/0969172f-4528-4a90-8628-1121113343ff-kube-api-access-mj82q\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923930 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-os-release\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.923967 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.924061 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:48.424040992 +0000 UTC m=+3.154483396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d325dfc6-0226-40f2-91bd-6ec23f095948-dbus\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924172 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-cni-binary-copy\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924191 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.923970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d325dfc6-0226-40f2-91bd-6ec23f095948-dbus\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924301 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-socket-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0969172f-4528-4a90-8628-1121113343ff-host\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924336 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-system-cni-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924353 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60e47115-227f-4d5d-85f9-0fca6f022b96-host-slash\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-cni-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924391 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-conf-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-cnibin\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924446 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-sys-fs\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.064874 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-socket-dir-parent\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-kubelet\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-multus-certs\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-netns\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/60e47115-227f-4d5d-85f9-0fca6f022b96-iptables-alerter-script\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924582 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-registration-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-k8s-cni-cncf-io\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924715 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-etc-kubernetes\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-cnibin\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924808 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a81c0c79-f53e-447f-a398-edacfb3dc77b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924863 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-conf-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a81c0c79-f53e-447f-a398-edacfb3dc77b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924882 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-os-release\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924915 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-cnibin\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924926 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-sys-fs\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924954 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-multus-certs\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.065531 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924984 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-system-cni-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.924996 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.924996 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925020 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-socket-dir-parent\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925023 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-cni-bin\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925041 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-device-dir\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0969172f-4528-4a90-8628-1121113343ff-serviceca\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925052 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d325dfc6-0226-40f2-91bd-6ec23f095948-kubelet-config\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925025 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0969172f-4528-4a90-8628-1121113343ff-host\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925091 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-var-lib-kubelet\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:47.925095 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:48.425076038 +0000 UTC m=+3.155518435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925112 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-host-run-netns\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.925166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-multus-cni-dir\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.937164 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8mdl\" (UniqueName: \"kubernetes.io/projected/a81c0c79-f53e-447f-a398-edacfb3dc77b-kube-api-access-w8mdl\") pod \"multus-additional-cni-plugins-dhj4r\" (UID: \"a81c0c79-f53e-447f-a398-edacfb3dc77b\") " pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.938633 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgkk\" (UniqueName: \"kubernetes.io/projected/b87dce76-9d3d-4ea8-9eee-9b8d6222c95d-kube-api-access-lpgkk\") pod \"aws-ebs-csi-driver-node-j645r\" (UID: \"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.940505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj82q\" (UniqueName: \"kubernetes.io/projected/0969172f-4528-4a90-8628-1121113343ff-kube-api-access-mj82q\") pod \"node-ca-mwr9d\" (UID: \"0969172f-4528-4a90-8628-1121113343ff\") " pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:48.066385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.941064 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-857bm\" (UniqueName: \"kubernetes.io/projected/5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb-kube-api-access-857bm\") pod \"multus-v87ct\" (UID: \"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb\") " pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.941102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8svxf\" (UniqueName: \"kubernetes.io/projected/60e47115-227f-4d5d-85f9-0fca6f022b96-kube-api-access-8svxf\") pod \"iptables-alerter-gwsfj\" (UID: \"60e47115-227f-4d5d-85f9-0fca6f022b96\") " pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:47.942683 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf756\" (UniqueName: \"kubernetes.io/projected/6d335f2e-9978-4088-ad57-c429506e14e0-kube-api-access-bf756\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.013187 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.023491 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2b2wp" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.032887 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2151aa60_2c27_44f9_827f_3ad2ecbdc6f7.slice/crio-2bcae27542ea311d96f1b28764ab8033d0bc532085e2cb1412c69bc08f7a07e7 WatchSource:0}: Error finding container 2bcae27542ea311d96f1b28764ab8033d0bc532085e2cb1412c69bc08f7a07e7: Status 404 returned error can't find the container with id 2bcae27542ea311d96f1b28764ab8033d0bc532085e2cb1412c69bc08f7a07e7 Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.047156 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.049473 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.058819 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" Jul 02 19:56:48.067430 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.061845 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54df8714_3929_4d8e_ae6f_75e04f6f266a.slice/crio-2cf8fbbf9a86c31f6ce648f75df90c16ecd0cec946991ea040089f73271ed487 WatchSource:0}: Error finding container 2cf8fbbf9a86c31f6ce648f75df90c16ecd0cec946991ea040089f73271ed487: Status 404 returned error can't find the container with id 2cf8fbbf9a86c31f6ce648f75df90c16ecd0cec946991ea040089f73271ed487 Jul 02 19:56:48.072508 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.072483 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mwr9d" Jul 02 19:56:48.074780 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.074749 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87dce76_9d3d_4ea8_9eee_9b8d6222c95d.slice/crio-d2dec86b401d197ee9b7beb66166e1ffa9cb067c0b1a4c20763ed129f652575d WatchSource:0}: Error finding container d2dec86b401d197ee9b7beb66166e1ffa9cb067c0b1a4c20763ed129f652575d: Status 404 returned error can't find the container with id d2dec86b401d197ee9b7beb66166e1ffa9cb067c0b1a4c20763ed129f652575d Jul 02 19:56:48.082002 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.081976 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0969172f_4528_4a90_8628_1121113343ff.slice/crio-ab1aab3166660cbea46548115ad5fc4af4a38f2923661fc49943a0f3e9a8228c WatchSource:0}: Error finding container ab1aab3166660cbea46548115ad5fc4af4a38f2923661fc49943a0f3e9a8228c: Status 404 returned error can't find the container with id ab1aab3166660cbea46548115ad5fc4af4a38f2923661fc49943a0f3e9a8228c Jul 02 19:56:48.085656 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.085551 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v87ct" Jul 02 19:56:48.095611 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.095587 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4dc9d5_acf3_4e92_8724_3e44e45cd6bb.slice/crio-b0fdfa9e7fba204b18bc0bcb8e579df7e5dc69e745c74b2a393afa2eaa883aa3 WatchSource:0}: Error finding container b0fdfa9e7fba204b18bc0bcb8e579df7e5dc69e745c74b2a393afa2eaa883aa3: Status 404 returned error can't find the container with id b0fdfa9e7fba204b18bc0bcb8e579df7e5dc69e745c74b2a393afa2eaa883aa3 Jul 02 19:56:48.122482 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.122454 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwsfj" Jul 02 19:56:48.131781 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.131754 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e47115_227f_4d5d_85f9_0fca6f022b96.slice/crio-eb065b238b1d11e0aa872a57721bcb342ca7dd4e68d144141b7fb8f7b0f6e92d WatchSource:0}: Error finding container eb065b238b1d11e0aa872a57721bcb342ca7dd4e68d144141b7fb8f7b0f6e92d: Status 404 returned error can't find the container with id eb065b238b1d11e0aa872a57721bcb342ca7dd4e68d144141b7fb8f7b0f6e92d Jul 02 19:56:48.145980 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.145955 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" Jul 02 19:56:48.156399 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:56:48.156372 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81c0c79_f53e_447f_a398_edacfb3dc77b.slice/crio-d1842a679fdab8f9496d8f5bfe59b77c41e1e1f972de5e0f7f5f6e014804d4ab WatchSource:0}: Error finding container d1842a679fdab8f9496d8f5bfe59b77c41e1e1f972de5e0f7f5f6e014804d4ab: Status 404 returned error can't find the container with id d1842a679fdab8f9496d8f5bfe59b77c41e1e1f972de5e0f7f5f6e014804d4ab Jul 02 19:56:48.427491 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.427400 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:48.427491 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.427463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.427503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427557 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427629 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427639 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427658 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427671 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427633 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:49.42761314 +0000 UTC m=+4.158055530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:48.427727 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427732 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:49.427715571 +0000 UTC m=+4.158157963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:48.428152 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.427749 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:56:49.42773844 +0000 UTC m=+4.158180826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:48.761512 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.761446 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:51:47 +0000 UTC" deadline="2028-02-27 12:05:11.399834462 +0000 UTC" Jul 02 19:56:48.761512 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.761508 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14512h8m22.638330562s" Jul 02 19:56:48.866313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.866278 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:48.866471 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:48.866408 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:48.882135 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.882100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v87ct" event={"ID":"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb","Type":"ContainerStarted","Data":"b0fdfa9e7fba204b18bc0bcb8e579df7e5dc69e745c74b2a393afa2eaa883aa3"} Jul 02 19:56:48.883451 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.883421 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mwr9d" event={"ID":"0969172f-4528-4a90-8628-1121113343ff","Type":"ContainerStarted","Data":"ab1aab3166660cbea46548115ad5fc4af4a38f2923661fc49943a0f3e9a8228c"} Jul 02 19:56:48.885021 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.884989 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" event={"ID":"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d","Type":"ContainerStarted","Data":"d2dec86b401d197ee9b7beb66166e1ffa9cb067c0b1a4c20763ed129f652575d"} Jul 02 19:56:48.886467 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.886412 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2b2wp" event={"ID":"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7","Type":"ContainerStarted","Data":"2bcae27542ea311d96f1b28764ab8033d0bc532085e2cb1412c69bc08f7a07e7"} Jul 02 19:56:48.887704 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.887682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerStarted","Data":"d1842a679fdab8f9496d8f5bfe59b77c41e1e1f972de5e0f7f5f6e014804d4ab"} Jul 02 19:56:48.889119 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.889094 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwsfj" event={"ID":"60e47115-227f-4d5d-85f9-0fca6f022b96","Type":"ContainerStarted","Data":"eb065b238b1d11e0aa872a57721bcb342ca7dd4e68d144141b7fb8f7b0f6e92d"} Jul 02 19:56:48.891431 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.891377 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjc8h" event={"ID":"54df8714-3929-4d8e-ae6f-75e04f6f266a","Type":"ContainerStarted","Data":"2cf8fbbf9a86c31f6ce648f75df90c16ecd0cec946991ea040089f73271ed487"} Jul 02 19:56:48.892993 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.892909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"22c572078d0da863e959944275df4ec2d7018062ee011404034e86c5209319a7"} Jul 02 19:56:48.894249 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:48.894206 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" event={"ID":"54440b1f-4ae0-4ada-a96c-449cb170b854","Type":"ContainerStarted","Data":"91b90fcb9f5603b8df96b7adf829df64cc395a7e9e9b10139e3669ce195c2ef4"} Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.439044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.439096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.439169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439291 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439348 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:51.439330322 +0000 UTC m=+6.169772709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439714 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439759 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:51.439744152 +0000 UTC m=+6.170186539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439834 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439848 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439861 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:49.439949 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.439894 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:56:51.439883638 +0000 UTC m=+6.170326025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:49.762180 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.762119 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:51:47 +0000 UTC" deadline="2028-03-22 19:37:03.54414962 +0000 UTC" Jul 02 19:56:49.762180 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.762155 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15095h40m13.781999084s" Jul 02 19:56:49.867071 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.866992 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:49.867208 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.867131 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:49.867508 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:49.867338 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:49.867508 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:49.867468 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:56:50.867354 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:50.867117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:50.867829 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:50.867465 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:50.924928 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:50.924891 2555 generic.go:356] "Generic (PLEG): container finished" podID="4452d912d9fcd2a9c82fa6d78e5f4634" containerID="96e5bae44b5591518b1d014577a49c23d0ab33b0893888b4661975bc36685eb0" exitCode=0 Jul 02 19:56:50.925089 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:50.924992 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" event={"ID":"4452d912d9fcd2a9c82fa6d78e5f4634","Type":"ContainerDied","Data":"96e5bae44b5591518b1d014577a49c23d0ab33b0893888b4661975bc36685eb0"} Jul 02 19:56:50.932922 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:50.932894 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" event={"ID":"2ca5057edadbcb38ff03c062e950e5d3","Type":"ContainerStarted","Data":"b1a484bbad8dbb84d3ab294c5b12bccbe68d180f1cb42b27da43b81cf8cf9bad"} Jul 02 19:56:51.455719 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:51.455684 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:51.455937 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:51.455743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:51.455937 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:51.455806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:51.456059 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.455943 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:51.456059 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456007 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:55.45598721 +0000 UTC m=+10.186429624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:51.456414 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456392 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:51.456487 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456453 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:55.45643675 +0000 UTC m=+10.186879138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:51.456549 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456532 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:56:51.456549 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456547 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:56:51.456647 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456560 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:51.456647 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.456594 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:56:55.45658344 +0000 UTC m=+10.187025825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:51.867498 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:51.867019 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:51.867498 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.867156 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:51.867498 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:51.867256 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:51.867498 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:51.867362 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:56:52.867795 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:52.867314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:52.867795 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:52.867451 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:53.866530 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:53.866498 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:53.866530 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:53.866529 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:53.866747 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:53.866622 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:56:53.866747 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:53.866718 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:54.866978 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:54.866925 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:54.867365 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:54.867065 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:55.488838 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:55.488801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:55.489044 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:55.488857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:55.489044 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:55.488930 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:55.489044 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.488981 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:55.489044 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489007 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:56:55.489044 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489028 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:56:55.489044 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489041 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:55.489317 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489057 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:03.48903434 +0000 UTC m=+18.219476737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:56:55.489317 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489012 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:55.489317 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489091 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:57:03.489075543 +0000 UTC m=+18.219517944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:56:55.489317 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.489123 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:03.48911077 +0000 UTC m=+18.219553166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:56:55.870103 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:55.870078 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:55.870103 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:55.870094 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:55.870588 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.870192 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:55.870588 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:55.870331 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:56:56.866634 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:56.866596 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:56.866812 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:56.866730 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:57.866539 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:57.866503 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:57.866961 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:57.866627 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:56:57.867123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:57.867089 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:57.867232 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:57.867199 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:58.866417 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:58.866382 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:56:58.866567 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:58.866486 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:56:59.866549 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:59.866519 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:56:59.867107 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:59.866666 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:56:59.867107 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:56:59.866725 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:56:59.867107 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:56:59.866811 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:00.867193 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:00.867154 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:00.867660 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:00.867281 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:01.866742 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:01.866707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:01.866953 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:01.866719 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:01.866953 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:01.866842 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:01.866953 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:01.866940 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:02.866545 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:02.866512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:02.867044 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:02.866632 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:03.549717 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:03.549681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:03.549911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:03.549735 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:03.549911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:03.549771 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:03.549911 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.549837 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:57:03.550051 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.549912 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:57:03.550051 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.549922 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:19.549900243 +0000 UTC m=+34.280342643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:57:03.550051 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.549934 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:57:03.550051 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.549949 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:57:03.550051 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.549989 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:57:19.549978224 +0000 UTC m=+34.280420608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:57:03.550051 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.550051 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:57:03.550292 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.550086 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:19.550073653 +0000 UTC m=+34.280516054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:57:03.867289 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:03.867212 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:03.867699 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:03.867217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:03.867699 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.867387 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:03.867699 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:03.867494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:04.867092 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:04.867054 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:04.867279 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:04.867171 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:05.867778 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:05.867738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:05.868311 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:05.867858 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:05.868311 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:05.867948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:05.868311 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:05.868170 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:06.866649 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:06.866605 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:06.866830 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:06.866732 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:07.867250 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.867079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:07.867685 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.867171 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:07.867685 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:07.867329 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:07.867685 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:07.867463 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:07.966964 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.966926 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" event={"ID":"4452d912d9fcd2a9c82fa6d78e5f4634","Type":"ContainerStarted","Data":"e5a81088805a7bae92e83267e4331b1ba44d12213af9ad6f2dd789474b7ce0d3"} Jul 02 19:57:07.968758 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.968730 2555 generic.go:356] "Generic (PLEG): container finished" podID="a81c0c79-f53e-447f-a398-edacfb3dc77b" containerID="eff0de889805130b55d4e36ccffb12741c8acfedba42758a3aa06d15cba44417" exitCode=0 Jul 02 19:57:07.968861 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.968776 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerDied","Data":"eff0de889805130b55d4e36ccffb12741c8acfedba42758a3aa06d15cba44417"} Jul 02 19:57:07.970569 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.970469 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gjc8h" event={"ID":"54df8714-3929-4d8e-ae6f-75e04f6f266a","Type":"ContainerStarted","Data":"2dab203f7b76692e977d1a13b0fa7d5ad55beff115e17e127e24cf4348e5d02c"} Jul 02 19:57:07.972294 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.972225 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" event={"ID":"54440b1f-4ae0-4ada-a96c-449cb170b854","Type":"ContainerStarted","Data":"d1c5291fd955e4b99426d7c1e53e8a87f26b8cbe59c63b3590071f57fa891b6d"} Jul 02 19:57:07.973768 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.973745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v87ct" event={"ID":"5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb","Type":"ContainerStarted","Data":"60c230d575d3dafa595c7560703f5ac10f15c041067062f4d337df476f6d6113"} Jul 02 19:57:07.975186 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.975156 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mwr9d" event={"ID":"0969172f-4528-4a90-8628-1121113343ff","Type":"ContainerStarted","Data":"bb87fe6817b32f1abcb01b8ebbcffa50307f53b12366084328f09c1b81609e3a"} Jul 02 19:57:07.976995 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.976974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" event={"ID":"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d","Type":"ContainerStarted","Data":"7aae690d2ba5f848bd60ce046b09b1844b3e4c6611b809dd5572439fb8e93b4a"} Jul 02 19:57:07.978209 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.978191 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2b2wp" event={"ID":"2151aa60-2c27-44f9-827f-3ad2ecbdc6f7","Type":"ContainerStarted","Data":"7278bdf4261a9432ff8b15465576363980ceba5ea92abd4274a8550d01ea92b2"} Jul 02 19:57:07.985509 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:07.985454 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-8.ec2.internal" podStartSLOduration=20.985437423 podStartE2EDuration="20.985437423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:50.96351871 +0000 UTC m=+5.693961119" watchObservedRunningTime="2026-07-02 19:57:07.985437423 +0000 UTC m=+22.715879830" Jul 02 19:57:08.002518 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.002475 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-8.ec2.internal" podStartSLOduration=21.002460442 podStartE2EDuration="21.002460442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:07.984964581 +0000 UTC m=+22.715406987" watchObservedRunningTime="2026-07-02 19:57:08.002460442 +0000 UTC m=+22.732902848" Jul 02 19:57:08.021171 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.021131 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7qrsx" podStartSLOduration=2.557715697 podStartE2EDuration="22.021115112s" totalImagesPullingTime="19.463399415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:08.00227749 +0000 UTC m=+22.732719896" watchObservedRunningTime="2026-07-02 19:57:08.021115112 +0000 UTC m=+22.751557518" Jul 02 19:57:08.040277 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.040235 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2b2wp" podStartSLOduration=2.596532593 podStartE2EDuration="22.040220699s" totalImagesPullingTime="19.443688106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:08.021826579 +0000 UTC m=+22.752268986" watchObservedRunningTime="2026-07-02 19:57:08.040220699 +0000 UTC m=+22.770663105" Jul 02 19:57:08.040551 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.040524 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v87ct" podStartSLOduration=2.634549701 podStartE2EDuration="22.040517655s" totalImagesPullingTime="19.405967954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:08.040118743 +0000 UTC m=+22.770561164" watchObservedRunningTime="2026-07-02 19:57:08.040517655 +0000 UTC m=+22.770960081" Jul 02 19:57:08.090665 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.090625 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mwr9d" podStartSLOduration=2.696163678 podStartE2EDuration="22.090610122s" totalImagesPullingTime="19.394446444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:08.090272926 +0000 UTC m=+22.820715332" watchObservedRunningTime="2026-07-02 19:57:08.090610122 +0000 UTC m=+22.821052558" Jul 02 19:57:08.091153 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.091123 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gjc8h" podStartSLOduration=7.220407558 podStartE2EDuration="22.091113606s" totalImagesPullingTime="14.870706048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:08.064040336 +0000 UTC m=+22.794482742" watchObservedRunningTime="2026-07-02 19:57:08.091113606 +0000 UTC m=+22.821556013" Jul 02 19:57:08.224422 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.224394 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:08.293998 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.293847 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:08.442146 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.442118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:08.540958 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.540933 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:57:08.541558 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.541539 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:57:08.541718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.541700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:08.611442 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.611414 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:08.866558 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.866528 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:08.866785 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:08.866657 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:08.943523 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.943491 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:08.981678 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.981650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwsfj" event={"ID":"60e47115-227f-4d5d-85f9-0fca6f022b96","Type":"ContainerStarted","Data":"da030c11503847e11149284336bd05a3494d2978327e9ce79999cf2ad6e13946"} Jul 02 19:57:08.985612 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.985590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 19:57:08.985999 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.985971 2555 generic.go:356] "Generic (PLEG): container finished" podID="e253eedb-7b33-4e2a-b532-e0ac3a0545f8" containerID="e89e8125b9a32019cc60de0e4bc1d512dfe9988d2645b908549e66ca6574f96f" exitCode=1 Jul 02 19:57:08.986114 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.985998 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"9eb815ffb6593895fc0f1ffa07b75b4a8306ff39d46eb597ee448e5a97471ad6"} Jul 02 19:57:08.986114 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.986066 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"816a000215bacd57158a83fc5aca87fabc38d1e5b4e2a48082a8e6e1e2568fc4"} Jul 02 19:57:08.986248 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.986115 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"b1c1dfee7e84faecd4254781c60edd3a79a818e4e864aaa20f6581bf29866e1d"} Jul 02 19:57:08.986248 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.986170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"afa1a5f3c7064d2b7829df74cb6cd76f62e1b64ed79e186e978b934491b95b33"} Jul 02 19:57:08.986248 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.986219 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerDied","Data":"e89e8125b9a32019cc60de0e4bc1d512dfe9988d2645b908549e66ca6574f96f"} Jul 02 19:57:08.986413 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.986269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"5007c015d33d1316f930572f85518289edd45769635bd0ee2c81d1880d086ecd"} Jul 02 19:57:08.986715 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.986689 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:57:08.987227 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:08.987198 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gjc8h" Jul 02 19:57:09.002098 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.002076 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:09.012006 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.011970 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwsfj" podStartSLOduration=3.6504236580000002 podStartE2EDuration="23.011957452s" totalImagesPullingTime="19.361533794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:08.997557291 +0000 UTC m=+23.727999698" watchObservedRunningTime="2026-07-02 19:57:09.011957452 +0000 UTC m=+23.742399857" Jul 02 19:57:09.066278 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.066246 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:09.270767 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.270746 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 19:57:09.736502 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.736473 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:09.821771 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.821639 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:57:09.270761783Z","UUID":"4028d8aa-6ee0-4b22-9554-8c667488412f","Handler":null,"Name":"","Endpoint":""} Jul 02 19:57:09.823498 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.823475 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 19:57:09.823631 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.823518 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 19:57:09.843240 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.843173 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:09.866564 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.866541 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:09.866716 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.866542 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:09.866716 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:09.866656 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:09.866808 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:09.866719 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:09.992950 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:09.992909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" event={"ID":"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d","Type":"ContainerStarted","Data":"11b1a3492eccd621ece41efdd567a131215ddad58fb4bd175dfba372e9b7c213"} Jul 02 19:57:10.144541 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:10.144506 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:10.240544 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:10.240509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:10.866581 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:10.866385 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:10.866694 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:10.866643 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:10.998170 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:10.998133 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 19:57:10.998597 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:10.998555 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"eaf6708e6ff2c3151710cfac7f7fba021c10bce3ce0012065fb616b9fe72d18f"} Jul 02 19:57:11.000938 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:11.000909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" event={"ID":"b87dce76-9d3d-4ea8-9eee-9b8d6222c95d","Type":"ContainerStarted","Data":"f0fba2f35b2493bf61034ab4e68b8566421391522eb645cb127bf718490c8482"} Jul 02 19:57:11.021287 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:11.021249 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j645r" podStartSLOduration=2.88139935 podStartE2EDuration="25.021236871s" totalImagesPullingTime="22.139837521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:11.021105901 +0000 UTC m=+25.751548306" watchObservedRunningTime="2026-07-02 19:57:11.021236871 +0000 UTC m=+25.751679276" Jul 02 19:57:11.866403 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:11.866369 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:11.866699 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:11.866494 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:11.866699 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:11.866546 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:11.866699 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:11.866639 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:12.867141 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:12.867106 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:12.867754 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:12.867231 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:13.866857 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:13.866692 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:13.867053 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:13.866697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:13.867053 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:13.866962 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:13.867053 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:13.867000 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:14.009168 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.009135 2555 generic.go:356] "Generic (PLEG): container finished" podID="a81c0c79-f53e-447f-a398-edacfb3dc77b" containerID="d148c0c28c9172824b23f2d6442aad3f3db2deae0a91354dfaca9e2eb5f1ba32" exitCode=0 Jul 02 19:57:14.009325 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.009214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerDied","Data":"d148c0c28c9172824b23f2d6442aad3f3db2deae0a91354dfaca9e2eb5f1ba32"} Jul 02 19:57:14.012784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.012766 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 19:57:14.013224 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.013203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"b8704243b889a186839a2b591415127961da313313269833553490b558a6bb7b"} Jul 02 19:57:14.013464 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.013439 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:57:14.013566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.013502 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:57:14.013566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.013551 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:57:14.013648 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.013604 2555 scope.go:117] "RemoveContainer" containerID="e89e8125b9a32019cc60de0e4bc1d512dfe9988d2645b908549e66ca6574f96f" Jul 02 19:57:14.028914 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.028893 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:57:14.029039 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.029028 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:57:14.157152 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.157086 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:14.260058 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.260021 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:14.764793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.764767 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:14.843199 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.843166 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:14.867119 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:14.867094 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:14.867268 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:14.867229 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:15.019102 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.018925 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 19:57:15.019394 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.019374 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" event={"ID":"e253eedb-7b33-4e2a-b532-e0ac3a0545f8","Type":"ContainerStarted","Data":"acc24f3b6fc2e14d7e4b74831018b4a5f57a435b6b95a67030575e534a04b4cd"} Jul 02 19:57:15.052442 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.052385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:15.057971 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.057927 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" podStartSLOduration=9.150072787 podStartE2EDuration="29.057907582s" totalImagesPullingTime="19.907834795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:15.056032477 +0000 UTC m=+29.786474897" watchObservedRunningTime="2026-07-02 19:57:15.057907582 +0000 UTC m=+29.788349989" Jul 02 19:57:15.091239 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.091201 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ts6nm"] Jul 02 19:57:15.091484 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.091315 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:15.091558 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:15.091497 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:15.092106 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.092059 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpw2q"] Jul 02 19:57:15.092198 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.092185 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:15.092293 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:15.092277 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:15.093041 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.093017 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d94cr"] Jul 02 19:57:15.093142 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.093093 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:15.093222 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:15.093175 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:15.147911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.147866 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:15.247268 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.247225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:15.452407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.452331 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:15.549493 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:15.549464 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:16.023510 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.023474 2555 generic.go:356] "Generic (PLEG): container finished" podID="a81c0c79-f53e-447f-a398-edacfb3dc77b" containerID="737e2a4d1963bca4af95ccc36dd715c257760c3137297be2304fc6d81582b8f7" exitCode=0 Jul 02 19:57:16.023942 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.023552 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerDied","Data":"737e2a4d1963bca4af95ccc36dd715c257760c3137297be2304fc6d81582b8f7"} Jul 02 19:57:16.111116 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.111090 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2b2wp_2151aa60-2c27-44f9-827f-3ad2ecbdc6f7/dns-node-resolver/0.log" Jul 02 19:57:16.133004 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.132973 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:16.234298 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.234265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:16.866597 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.866570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:16.866750 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.866656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:16.866750 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:16.866662 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:16.866750 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:16.866667 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:16.866750 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:16.866725 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:16.866901 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:16.866828 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:17.107573 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:17.107539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:17.189590 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:17.189560 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:17.311285 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:17.311261 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mwr9d_0969172f-4528-4a90-8628-1121113343ff/node-ca/0.log" Jul 02 19:57:18.030892 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.030853 2555 generic.go:356] "Generic (PLEG): container finished" podID="a81c0c79-f53e-447f-a398-edacfb3dc77b" containerID="eeff9382dbdd409ff4a1cd8f1112ced4712073d0e2e9fd4e8209dfb841a7ea68" exitCode=0 Jul 02 19:57:18.031050 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.030908 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerDied","Data":"eeff9382dbdd409ff4a1cd8f1112ced4712073d0e2e9fd4e8209dfb841a7ea68"} Jul 02 19:57:18.274769 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.274736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:18.374836 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.374737 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:18.482652 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.482617 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:18.866265 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.866231 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:18.866503 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.866303 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:18.866503 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.866326 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:18.866503 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:18.866424 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:18.866682 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:18.866551 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:18.866682 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:18.866622 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:18.885307 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.885270 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:18.986007 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:18.985973 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:19.087826 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.087767 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:19.188930 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.188820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:19.262918 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.262867 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:19.572052 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.572014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.572078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.572113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572182 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572207 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572222 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572238 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572250 2555 projected.go:196] Error preparing data for projected volume kube-api-access-c6ggs for pod openshift-network-diagnostics/network-check-target-d94cr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572260 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret podName:d325dfc6-0226-40f2-91bd-6ec23f095948 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:51.5722403 +0000 UTC m=+66.302682701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret") pod "global-pull-secret-syncer-ts6nm" (UID: "d325dfc6-0226-40f2-91bd-6ec23f095948") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572279 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs podName:6d335f2e-9978-4088-ad57-c429506e14e0 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:51.572270473 +0000 UTC m=+66.302712860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs") pod "network-metrics-daemon-bpw2q" (UID: "6d335f2e-9978-4088-ad57-c429506e14e0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:57:19.572492 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:19.572297 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs podName:f32689c2-77ec-4790-8d1d-448d6f7af76c nodeName:}" failed. No retries permitted until 2026-07-02 19:57:51.572286375 +0000 UTC m=+66.302728760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ggs" (UniqueName: "kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs") pod "network-check-target-d94cr" (UID: "f32689c2-77ec-4790-8d1d-448d6f7af76c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:57:19.760438 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.760407 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:19.949688 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:19.949654 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:20.866391 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:20.866357 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:20.866839 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:20.866469 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:20.866839 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:20.866482 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:20.866839 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:20.866497 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:20.866839 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:20.866571 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:20.866839 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:20.866646 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:20.952611 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:20.952566 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:21.150373 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:21.150290 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:21.577851 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:21.577788 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:21.755399 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:21.755366 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:22.034755 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.034718 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:22.160861 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.160780 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:22.549805 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.549553 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:22.770067 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.770031 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:22.866833 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.866807 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:22.866983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.866916 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:22.866983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.866924 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:22.867107 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:22.866915 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:22.867107 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:22.867006 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:22.867107 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:22.867067 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:22.927812 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:22.927783 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:23.020962 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:23.020859 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:23.044810 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:23.044784 2555 generic.go:356] "Generic (PLEG): container finished" podID="a81c0c79-f53e-447f-a398-edacfb3dc77b" containerID="eb527ce43165a1ea34e7a29cda74cd0626f4352b87fcebc094249a5880bfbcb0" exitCode=0 Jul 02 19:57:23.045152 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:23.044841 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerDied","Data":"eb527ce43165a1ea34e7a29cda74cd0626f4352b87fcebc094249a5880bfbcb0"} Jul 02 19:57:23.551288 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:23.551256 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:23.652137 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:23.652108 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:24.049523 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.049490 2555 generic.go:356] "Generic (PLEG): container finished" podID="a81c0c79-f53e-447f-a398-edacfb3dc77b" containerID="74ce3485731a792cd67329e51067ca94f18e64c554a61c20ffeb5e0ee92f43e2" exitCode=0 Jul 02 19:57:24.049896 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.049540 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerDied","Data":"74ce3485731a792cd67329e51067ca94f18e64c554a61c20ffeb5e0ee92f43e2"} Jul 02 19:57:24.154233 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.154208 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:24.351569 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.351481 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:24.750456 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.750420 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:24.853282 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.853240 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:24.867157 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.867132 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:24.867157 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.867152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:24.867319 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.867155 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:24.867319 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:24.867229 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:24.867392 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:24.867310 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:24.867392 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:24.867356 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:24.955572 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:24.955451 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:25.030354 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:25.030322 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:25.055106 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:25.055072 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" event={"ID":"a81c0c79-f53e-447f-a398-edacfb3dc77b","Type":"ContainerStarted","Data":"a9fc61f8fe86550e91758c1d438ae4d8d4f3b2ed5cfa77beab4b39230309750e"} Jul 02 19:57:25.087287 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:25.087237 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dhj4r" podStartSLOduration=8.095102335 podStartE2EDuration="39.087223585s" totalImagesPullingTime="30.99212125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:25.086187293 +0000 UTC m=+39.816629700" watchObservedRunningTime="2026-07-02 19:57:25.087223585 +0000 UTC m=+39.817665991" Jul 02 19:57:25.172923 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:25.172871 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:25.369935 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:25.369907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:26.183894 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.183847 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:26.637924 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.637894 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:26.781856 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.781816 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:26.866655 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.866625 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:26.866822 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.866732 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:26.866822 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.866741 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:26.866822 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:26.866741 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:26.866822 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:26.866812 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:26.867160 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:26.866890 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:26.947795 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:26.947720 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:27.346571 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:27.346533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:27.746844 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:27.746814 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:28.355137 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:28.355103 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:28.752461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:28.752432 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:28.866955 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:28.866924 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:28.866955 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:28.866943 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:28.866955 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:28.866941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:28.867235 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:28.867038 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:28.867235 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:28.867087 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:28.867235 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:28.867150 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:29.145902 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:29.145803 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:29.375293 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:29.375266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:29.445171 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:29.445105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:29.545568 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:29.545537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:30.866627 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:30.866596 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:30.867095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:30.866686 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:30.867095 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:30.866691 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:30.867095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:30.866713 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:30.867095 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:30.866777 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:30.867095 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:30.866841 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:32.866769 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:32.866739 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:32.867186 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:32.866826 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:32.867186 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:32.866831 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:32.867186 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:32.866924 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:32.867186 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:32.866834 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:32.867186 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:32.867013 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:33.261996 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:33.261963 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:33.336174 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:33.336143 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:34.866479 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:34.866450 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:34.866846 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:34.866450 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:34.866846 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:34.866544 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:34.866846 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:34.866450 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:34.866846 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:34.866620 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:34.866846 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:34.866685 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:36.866499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:36.866470 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:36.866869 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:36.866564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:36.866869 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:36.866566 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:36.866869 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:36.866572 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:36.866869 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:36.866648 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:36.866869 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:36.866797 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:37.868472 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:37.868437 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:38.011388 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.011356 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:38.155368 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.155280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:38.373855 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.373826 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:38.633572 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.633545 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:38.866941 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.866898 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:38.866941 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.866933 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:38.867174 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:38.866988 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:38.867174 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:38.866999 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ts6nm" podUID="d325dfc6-0226-40f2-91bd-6ec23f095948" Jul 02 19:57:38.867174 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:38.867062 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d94cr" podUID="f32689c2-77ec-4790-8d1d-448d6f7af76c" Jul 02 19:57:38.867174 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:38.867151 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bpw2q" podUID="6d335f2e-9978-4088-ad57-c429506e14e0" Jul 02 19:57:39.085246 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.085213 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:39.376408 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.376324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:39.478543 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.478518 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-8.ec2.internal" event="NodeReady" Jul 02 19:57:39.478689 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.478621 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 19:57:39.822542 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.822507 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:39.883206 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.883175 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mkx7d"] Jul 02 19:57:39.906541 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.906512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:39.909831 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.909814 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w4q8x\"" Jul 02 19:57:39.911131 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.911116 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 19:57:39.911205 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.911120 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 19:57:39.919161 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.919141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/824a8cc9-2568-42e8-9096-3e2479c6b970-metrics-tls\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:39.919241 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.919193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/824a8cc9-2568-42e8-9096-3e2479c6b970-config-volume\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:39.919241 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.919230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chw2h\" (UniqueName: \"kubernetes.io/projected/824a8cc9-2568-42e8-9096-3e2479c6b970-kube-api-access-chw2h\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:39.919329 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.919257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824a8cc9-2568-42e8-9096-3e2479c6b970-tmp-dir\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:39.922897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:39.922857 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mkx7d"] Jul 02 19:57:40.001957 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.001925 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-spxl5"] Jul 02 19:57:40.020202 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.020177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/824a8cc9-2568-42e8-9096-3e2479c6b970-config-volume\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.020314 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.020215 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chw2h\" (UniqueName: \"kubernetes.io/projected/824a8cc9-2568-42e8-9096-3e2479c6b970-kube-api-access-chw2h\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.020314 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.020254 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824a8cc9-2568-42e8-9096-3e2479c6b970-tmp-dir\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.020314 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.020292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/824a8cc9-2568-42e8-9096-3e2479c6b970-metrics-tls\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.020580 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.020561 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824a8cc9-2568-42e8-9096-3e2479c6b970-tmp-dir\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.020807 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.020789 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/824a8cc9-2568-42e8-9096-3e2479c6b970-config-volume\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.023418 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.023404 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.024461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.024443 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/824a8cc9-2568-42e8-9096-3e2479c6b970-metrics-tls\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.033601 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.033576 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 19:57:40.033711 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.033629 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 19:57:40.043315 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.043296 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 19:57:40.043702 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.043687 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-57z4p\"" Jul 02 19:57:40.043929 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.043917 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 19:57:40.059160 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.059143 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-spxl5"] Jul 02 19:57:40.064073 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.064049 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-25nph"] Jul 02 19:57:40.064178 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.064161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chw2h\" (UniqueName: \"kubernetes.io/projected/824a8cc9-2568-42e8-9096-3e2479c6b970-kube-api-access-chw2h\") pod \"dns-default-mkx7d\" (UID: \"824a8cc9-2568-42e8-9096-3e2479c6b970\") " pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.083286 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.083240 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.086783 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.086767 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cg89q\"" Jul 02 19:57:40.087328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.087314 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 19:57:40.087619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.087602 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 19:57:40.087669 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.087657 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 19:57:40.096950 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.096926 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.121001 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.120983 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4a4da98-f606-4357-b5bb-25c94a6fb4d1-cert\") pod \"ingress-canary-25nph\" (UID: \"b4a4da98-f606-4357-b5bb-25c94a6fb4d1\") " pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.121071 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.121033 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-data-volume\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.121071 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.121056 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.121242 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.121119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.121242 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.121159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq9b6\" (UniqueName: \"kubernetes.io/projected/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-kube-api-access-lq9b6\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.121242 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.121185 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgbpb\" (UniqueName: \"kubernetes.io/projected/b4a4da98-f606-4357-b5bb-25c94a6fb4d1-kube-api-access-bgbpb\") pod \"ingress-canary-25nph\" (UID: \"b4a4da98-f606-4357-b5bb-25c94a6fb4d1\") " pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.121357 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.121239 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-crio-socket\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.124949 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.124931 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-25nph"] Jul 02 19:57:40.215003 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.214980 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:40.221635 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-data-volume\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.221713 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221645 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.221713 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.221783 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq9b6\" (UniqueName: \"kubernetes.io/projected/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-kube-api-access-lq9b6\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.221815 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221801 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgbpb\" (UniqueName: \"kubernetes.io/projected/b4a4da98-f606-4357-b5bb-25c94a6fb4d1-kube-api-access-bgbpb\") pod \"ingress-canary-25nph\" (UID: \"b4a4da98-f606-4357-b5bb-25c94a6fb4d1\") " pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.221885 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-crio-socket\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.221976 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221958 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-crio-socket\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.222033 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.221961 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-data-volume\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.222088 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.222043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4a4da98-f606-4357-b5bb-25c94a6fb4d1-cert\") pod \"ingress-canary-25nph\" (UID: \"b4a4da98-f606-4357-b5bb-25c94a6fb4d1\") " pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.222198 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.222183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.224046 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.224028 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.224347 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.224330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4a4da98-f606-4357-b5bb-25c94a6fb4d1-cert\") pod \"ingress-canary-25nph\" (UID: \"b4a4da98-f606-4357-b5bb-25c94a6fb4d1\") " pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.242772 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.242740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgbpb\" (UniqueName: \"kubernetes.io/projected/b4a4da98-f606-4357-b5bb-25c94a6fb4d1-kube-api-access-bgbpb\") pod \"ingress-canary-25nph\" (UID: \"b4a4da98-f606-4357-b5bb-25c94a6fb4d1\") " pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.244236 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.244220 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq9b6\" (UniqueName: \"kubernetes.io/projected/3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4-kube-api-access-lq9b6\") pod \"insights-runtime-extractor-spxl5\" (UID: \"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4\") " pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.276846 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.276821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.335962 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.335900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-spxl5" Jul 02 19:57:40.392165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.392136 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-25nph" Jul 02 19:57:40.419196 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.418948 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mkx7d"] Jul 02 19:57:40.422677 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.422648 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.423845 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:40.423823 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824a8cc9_2568_42e8_9096_3e2479c6b970.slice/crio-8e79304def3dec16b07be943231bcb5afafc302529259603002fa3a271b6a8ef WatchSource:0}: Error finding container 8e79304def3dec16b07be943231bcb5afafc302529259603002fa3a271b6a8ef: Status 404 returned error can't find the container with id 8e79304def3dec16b07be943231bcb5afafc302529259603002fa3a271b6a8ef Jul 02 19:57:40.522044 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.522017 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-spxl5"] Jul 02 19:57:40.526675 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:40.526647 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7938cc_edd3_4e31_b7f5_00d0e2fb49b4.slice/crio-92d9ed48edf9823f8ec4759a70f4f131b26ed2a7e5524bd6464fab96d1ea16ee WatchSource:0}: Error finding container 92d9ed48edf9823f8ec4759a70f4f131b26ed2a7e5524bd6464fab96d1ea16ee: Status 404 returned error can't find the container with id 92d9ed48edf9823f8ec4759a70f4f131b26ed2a7e5524bd6464fab96d1ea16ee Jul 02 19:57:40.563998 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.563974 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-25nph"] Jul 02 19:57:40.567089 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:40.567066 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a4da98_f606_4357_b5bb_25c94a6fb4d1.slice/crio-da53a60b2702437cc0e8cd21c9194ec75d207de6ef85244c8b40f1ea1e15aaac WatchSource:0}: Error finding container da53a60b2702437cc0e8cd21c9194ec75d207de6ef85244c8b40f1ea1e15aaac: Status 404 returned error can't find the container with id da53a60b2702437cc0e8cd21c9194ec75d207de6ef85244c8b40f1ea1e15aaac Jul 02 19:57:40.629636 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.629571 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.776526 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.776490 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:40.867005 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.866979 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:40.867157 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.867079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:40.867157 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.867105 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:40.872574 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.872547 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:57:40.872703 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.872586 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:57:40.873578 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.873520 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:57:40.874048 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.873830 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tj5bt\"" Jul 02 19:57:40.874048 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.873912 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g6jwx\"" Jul 02 19:57:40.874048 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:40.874021 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:57:41.089755 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:41.089652 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-25nph" event={"ID":"b4a4da98-f606-4357-b5bb-25c94a6fb4d1","Type":"ContainerStarted","Data":"da53a60b2702437cc0e8cd21c9194ec75d207de6ef85244c8b40f1ea1e15aaac"} Jul 02 19:57:41.090974 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:41.090946 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spxl5" event={"ID":"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4","Type":"ContainerStarted","Data":"92d9ed48edf9823f8ec4759a70f4f131b26ed2a7e5524bd6464fab96d1ea16ee"} Jul 02 19:57:41.092205 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:41.092177 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mkx7d" event={"ID":"824a8cc9-2568-42e8-9096-3e2479c6b970","Type":"ContainerStarted","Data":"8e79304def3dec16b07be943231bcb5afafc302529259603002fa3a271b6a8ef"} Jul 02 19:57:42.436356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.436292 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:42.663339 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.663303 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:42.767153 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.767116 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm"] Jul 02 19:57:42.770816 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.770797 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:42.778292 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.778258 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 19:57:42.778402 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.778362 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f2cbt\"" Jul 02 19:57:42.802269 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.802243 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm"] Jul 02 19:57:42.843259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.843218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b542383-fcad-4a85-a154-4674b5d074c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xbbzm\" (UID: \"4b542383-fcad-4a85-a154-4674b5d074c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:42.884350 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.884295 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:42.943952 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.943923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b542383-fcad-4a85-a154-4674b5d074c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xbbzm\" (UID: \"4b542383-fcad-4a85-a154-4674b5d074c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:42.946734 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:42.946708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4b542383-fcad-4a85-a154-4674b5d074c1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-xbbzm\" (UID: \"4b542383-fcad-4a85-a154-4674b5d074c1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:43.028084 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:43.027998 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:43.081017 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:43.080985 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:44.134458 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:44.134416 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:44.281212 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:44.281174 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:45.593068 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.593010 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:45.605920 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.605896 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d5487c69d-8jdld"] Jul 02 19:57:45.608976 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.608948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.613229 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.613041 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6brdh\"" Jul 02 19:57:45.613229 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.613138 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:57:45.614329 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.614112 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:57:45.614329 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.614146 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:57:45.614490 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.614351 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:57:45.615042 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.614698 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:57:45.615042 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.614907 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:57:45.616011 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.615829 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:57:45.634904 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.631010 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5487c69d-8jdld"] Jul 02 19:57:45.661920 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.661371 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm"] Jul 02 19:57:45.665717 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.665687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-oauth-serving-cert\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.665833 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.665756 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6q59\" (UniqueName: \"kubernetes.io/projected/e4f23017-80ee-40d9-8cbf-8bd72a22d809-kube-api-access-c6q59\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.665833 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.665788 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-oauth-config\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.665833 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.665815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-config\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.666012 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.665838 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-service-ca\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.666012 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.665939 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-serving-cert\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.667586 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:45.667562 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b542383_fcad_4a85_a154_4674b5d074c1.slice/crio-22f1a7e4992f8e37540c0ba4521108f08f26ca1ebdb3a49025a7891ef9a7c59b WatchSource:0}: Error finding container 22f1a7e4992f8e37540c0ba4521108f08f26ca1ebdb3a49025a7891ef9a7c59b: Status 404 returned error can't find the container with id 22f1a7e4992f8e37540c0ba4521108f08f26ca1ebdb3a49025a7891ef9a7c59b Jul 02 19:57:45.693023 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.692102 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:45.767175 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.767112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-oauth-serving-cert\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.767175 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.767160 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6q59\" (UniqueName: \"kubernetes.io/projected/e4f23017-80ee-40d9-8cbf-8bd72a22d809-kube-api-access-c6q59\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.767369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.767274 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-oauth-config\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.767369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.767311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-config\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.767369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.767329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-service-ca\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.767528 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.767395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-serving-cert\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.772575 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.772552 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:57:45.772710 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.772637 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:57:45.772777 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.772752 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:57:45.772834 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.772775 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:57:45.773096 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.773082 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:57:45.777787 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.777768 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-oauth-serving-cert\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.778378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.778354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-service-ca\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.778485 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.778395 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-config\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.780042 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.780021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-oauth-config\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.780313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.780294 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-serving-cert\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.783362 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.783343 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:57:45.792152 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.792118 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:57:45.802206 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.802181 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6q59\" (UniqueName: \"kubernetes.io/projected/e4f23017-80ee-40d9-8cbf-8bd72a22d809-kube-api-access-c6q59\") pod \"console-5d5487c69d-8jdld\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:45.929286 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.929255 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6brdh\"" Jul 02 19:57:45.933798 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:45.933783 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:46.036730 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.036655 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xwmpf" Jul 02 19:57:46.077414 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.077260 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5487c69d-8jdld"] Jul 02 19:57:46.107857 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.107822 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" event={"ID":"4b542383-fcad-4a85-a154-4674b5d074c1","Type":"ContainerStarted","Data":"22f1a7e4992f8e37540c0ba4521108f08f26ca1ebdb3a49025a7891ef9a7c59b"} Jul 02 19:57:46.109462 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.109429 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-25nph" event={"ID":"b4a4da98-f606-4357-b5bb-25c94a6fb4d1","Type":"ContainerStarted","Data":"30edc4fc42e04e30c2ad99b7a100ee27f94aa32001e3df91f6795a488112a1d6"} Jul 02 19:57:46.111167 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.111143 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spxl5" event={"ID":"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4","Type":"ContainerStarted","Data":"c82f863721f1999e7cc92ae01436178aeae0d8e9bdcc5cb1557d75f5fe124af4"} Jul 02 19:57:46.113226 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.113105 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mkx7d" event={"ID":"824a8cc9-2568-42e8-9096-3e2479c6b970","Type":"ContainerStarted","Data":"4c6e1e06c0d3aed71c281d0905b9638bb86a117c7cbf6d5fe1186b1c8f9ffee3"} Jul 02 19:57:46.113226 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.113162 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mkx7d" event={"ID":"824a8cc9-2568-42e8-9096-3e2479c6b970","Type":"ContainerStarted","Data":"7bc34614a5eb48c7b5391c094503e514b8a1997d5a4e009ac96eb5ce15660b5c"} Jul 02 19:57:46.113432 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.113412 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:46.154255 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.154188 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-25nph" podStartSLOduration=1.208006728 podStartE2EDuration="6.154168501s" totalImagesPullingTime="4.946161773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:46.152923617 +0000 UTC m=+60.883366021" watchObservedRunningTime="2026-07-02 19:57:46.154168501 +0000 UTC m=+60.884610908" Jul 02 19:57:46.156760 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:46.156732 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f23017_80ee_40d9_8cbf_8bd72a22d809.slice/crio-e992f76c267aff53d661934b1fb121b040a22a4df78b38cd493a7231cc628b6f WatchSource:0}: Error finding container e992f76c267aff53d661934b1fb121b040a22a4df78b38cd493a7231cc628b6f: Status 404 returned error can't find the container with id e992f76c267aff53d661934b1fb121b040a22a4df78b38cd493a7231cc628b6f Jul 02 19:57:46.188347 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.188255 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mkx7d" podStartSLOduration=2.107469715 podStartE2EDuration="7.188239667s" totalImagesPullingTime="5.080769952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:46.187863256 +0000 UTC m=+60.918305666" watchObservedRunningTime="2026-07-02 19:57:46.188239667 +0000 UTC m=+60.918682073" Jul 02 19:57:46.309076 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.309002 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:46.421887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:46.421834 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:47.118959 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:47.118916 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spxl5" event={"ID":"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4","Type":"ContainerStarted","Data":"f2863c15fe56ee09b89962e6d59b876ee84e6bad571a9500a2836d9be3e353d1"} Jul 02 19:57:47.120238 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:47.120207 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5487c69d-8jdld" event={"ID":"e4f23017-80ee-40d9-8cbf-8bd72a22d809","Type":"ContainerStarted","Data":"e992f76c267aff53d661934b1fb121b040a22a4df78b38cd493a7231cc628b6f"} Jul 02 19:57:48.126603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.126566 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" event={"ID":"4b542383-fcad-4a85-a154-4674b5d074c1","Type":"ContainerStarted","Data":"643f0f41064a9d4d3c239ee56d6eb82fdbad4e4b55a0af36f6195c5d70514d31"} Jul 02 19:57:48.127079 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.126929 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:48.132695 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.132671 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" Jul 02 19:57:48.163482 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.163426 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-xbbzm" podStartSLOduration=4.812281183 podStartE2EDuration="6.163405749s" totalImagesPullingTime="1.351124566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:48.162501237 +0000 UTC m=+62.892943643" watchObservedRunningTime="2026-07-02 19:57:48.163405749 +0000 UTC m=+62.893848156" Jul 02 19:57:48.297022 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.296965 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:48.373935 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.373901 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:48.758773 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.758727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:48.804691 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.804662 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86"] Jul 02 19:57:48.810259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.810233 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.814836 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.814812 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 19:57:48.815312 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.815116 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 19:57:48.815312 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.815256 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h848h\"" Jul 02 19:57:48.816230 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.816158 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 19:57:48.816351 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.816233 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 19:57:48.816351 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.816236 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 19:57:48.831369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.831348 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86"] Jul 02 19:57:48.891734 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.891698 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c69fba04-e867-40b6-a59e-0ef76343f44b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.891945 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.891796 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mcr2\" (UniqueName: \"kubernetes.io/projected/c69fba04-e867-40b6-a59e-0ef76343f44b-kube-api-access-4mcr2\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.891945 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.891842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69fba04-e867-40b6-a59e-0ef76343f44b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.891945 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.891911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69fba04-e867-40b6-a59e-0ef76343f44b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.898270 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.898229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:48.993023 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.992987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69fba04-e867-40b6-a59e-0ef76343f44b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.994346 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.993041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69fba04-e867-40b6-a59e-0ef76343f44b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.994672 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.994630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c69fba04-e867-40b6-a59e-0ef76343f44b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.994765 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.994727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mcr2\" (UniqueName: \"kubernetes.io/projected/c69fba04-e867-40b6-a59e-0ef76343f44b-kube-api-access-4mcr2\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.998108 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.995560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c69fba04-e867-40b6-a59e-0ef76343f44b-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.998108 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.997777 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c69fba04-e867-40b6-a59e-0ef76343f44b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:48.999829 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:48.999804 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c69fba04-e867-40b6-a59e-0ef76343f44b-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:49.007442 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.007395 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mcr2\" (UniqueName: \"kubernetes.io/projected/c69fba04-e867-40b6-a59e-0ef76343f44b-kube-api-access-4mcr2\") pod \"prometheus-operator-567f7b8b7c-x2z86\" (UID: \"c69fba04-e867-40b6-a59e-0ef76343f44b\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:49.065183 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.065082 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:49.120163 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.120119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" Jul 02 19:57:49.587499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.587461 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f45f95454-l2nkv"] Jul 02 19:57:49.590069 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.590041 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.590293 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.590240 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:49.599553 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.599527 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 19:57:49.602962 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.602940 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f45f95454-l2nkv"] Jul 02 19:57:49.700658 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-trusted-ca-bundle\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.700848 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700666 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnzlx\" (UniqueName: \"kubernetes.io/projected/6dd1e11a-8ae6-4875-a46d-376abe841a2c-kube-api-access-xnzlx\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.700848 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700691 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-config\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.700848 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700773 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-oauth-config\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.701024 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700869 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-serving-cert\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.701024 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700920 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-service-ca\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.701024 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.700945 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-oauth-serving-cert\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802126 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-config\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-oauth-config\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-serving-cert\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-service-ca\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-oauth-serving-cert\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802538 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802340 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-trusted-ca-bundle\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.802538 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.802365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnzlx\" (UniqueName: \"kubernetes.io/projected/6dd1e11a-8ae6-4875-a46d-376abe841a2c-kube-api-access-xnzlx\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.803033 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.803002 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-service-ca\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.803153 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.803133 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-config\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.803394 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.803368 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-oauth-serving-cert\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.803761 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.803739 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-trusted-ca-bundle\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.804907 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.804870 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-oauth-config\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.805514 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.805490 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-serving-cert\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.812770 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.812748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnzlx\" (UniqueName: \"kubernetes.io/projected/6dd1e11a-8ae6-4875-a46d-376abe841a2c-kube-api-access-xnzlx\") pod \"console-7f45f95454-l2nkv\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:49.901548 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:49.901478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:50.357648 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:50.357612 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f45f95454-l2nkv"] Jul 02 19:57:50.361007 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:50.360982 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd1e11a_8ae6_4875_a46d_376abe841a2c.slice/crio-134279ad40027b88205ad937aace82106fa139d7c971eaebb9ca5ee42cffade5 WatchSource:0}: Error finding container 134279ad40027b88205ad937aace82106fa139d7c971eaebb9ca5ee42cffade5: Status 404 returned error can't find the container with id 134279ad40027b88205ad937aace82106fa139d7c971eaebb9ca5ee42cffade5 Jul 02 19:57:50.371778 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:50.371753 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86"] Jul 02 19:57:50.376220 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:50.376197 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69fba04_e867_40b6_a59e_0ef76343f44b.slice/crio-edb950387982ca9648695855dcd39b2fe6044a6c2566daa28e9e5b4820532e18 WatchSource:0}: Error finding container edb950387982ca9648695855dcd39b2fe6044a6c2566daa28e9e5b4820532e18: Status 404 returned error can't find the container with id edb950387982ca9648695855dcd39b2fe6044a6c2566daa28e9e5b4820532e18 Jul 02 19:57:51.138585 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.138549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5487c69d-8jdld" event={"ID":"e4f23017-80ee-40d9-8cbf-8bd72a22d809","Type":"ContainerStarted","Data":"bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb"} Jul 02 19:57:51.139893 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.139858 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" event={"ID":"c69fba04-e867-40b6-a59e-0ef76343f44b","Type":"ContainerStarted","Data":"edb950387982ca9648695855dcd39b2fe6044a6c2566daa28e9e5b4820532e18"} Jul 02 19:57:51.141759 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.141739 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-spxl5" event={"ID":"3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4","Type":"ContainerStarted","Data":"f838ecaf2e2789f6bb2b0b21862be0e47ea5edb47cbdb40fb23485d7fe390f9e"} Jul 02 19:57:51.143282 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.143264 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f45f95454-l2nkv" event={"ID":"6dd1e11a-8ae6-4875-a46d-376abe841a2c","Type":"ContainerStarted","Data":"06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571"} Jul 02 19:57:51.143366 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.143293 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f45f95454-l2nkv" event={"ID":"6dd1e11a-8ae6-4875-a46d-376abe841a2c","Type":"ContainerStarted","Data":"134279ad40027b88205ad937aace82106fa139d7c971eaebb9ca5ee42cffade5"} Jul 02 19:57:51.160555 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.160515 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d5487c69d-8jdld" podStartSLOduration=2.089001999 podStartE2EDuration="6.160502788s" totalImagesPullingTime="4.071500789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:51.159040946 +0000 UTC m=+65.889483352" watchObservedRunningTime="2026-07-02 19:57:51.160502788 +0000 UTC m=+65.890945193" Jul 02 19:57:51.179026 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.178966 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f45f95454-l2nkv" podStartSLOduration=2.178948201 podStartE2EDuration="2.178948201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:51.177591087 +0000 UTC m=+65.908033495" watchObservedRunningTime="2026-07-02 19:57:51.178948201 +0000 UTC m=+65.909390610" Jul 02 19:57:51.197959 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.197909 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-spxl5" podStartSLOduration=2.660228881 podStartE2EDuration="12.197890955s" totalImagesPullingTime="9.537662074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:57:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:51.196514606 +0000 UTC m=+65.926957029" watchObservedRunningTime="2026-07-02 19:57:51.197890955 +0000 UTC m=+65.928333358" Jul 02 19:57:51.371961 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.371895 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:51.472939 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.472837 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:51.617243 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.617209 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:51.617437 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.617408 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:51.617503 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.617463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:51.621482 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.621457 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:57:51.622540 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.622515 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:57:51.622540 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.622528 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:57:51.630358 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.630335 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d335f2e-9978-4088-ad57-c429506e14e0-metrics-certs\") pod \"network-metrics-daemon-bpw2q\" (UID: \"6d335f2e-9978-4088-ad57-c429506e14e0\") " pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:51.630453 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.630396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d325dfc6-0226-40f2-91bd-6ec23f095948-original-pull-secret\") pod \"global-pull-secret-syncer-ts6nm\" (UID: \"d325dfc6-0226-40f2-91bd-6ec23f095948\") " pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:51.630453 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.630428 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:57:51.641364 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.641344 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ggs\" (UniqueName: \"kubernetes.io/projected/f32689c2-77ec-4790-8d1d-448d6f7af76c-kube-api-access-c6ggs\") pod \"network-check-target-d94cr\" (UID: \"f32689c2-77ec-4790-8d1d-448d6f7af76c\") " pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:51.676727 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.676707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ts6nm" Jul 02 19:57:51.684747 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.684728 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g6jwx\"" Jul 02 19:57:51.689125 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.689106 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tj5bt\"" Jul 02 19:57:51.692220 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.692198 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:51.697827 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.697805 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bpw2q" Jul 02 19:57:51.853414 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.853342 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ts6nm"] Jul 02 19:57:51.871610 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.871545 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d94cr"] Jul 02 19:57:51.874649 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:51.874620 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32689c2_77ec_4790_8d1d_448d6f7af76c.slice/crio-650009cf3d50b7ce7b73d2959741ef4fb99d5e9a25abfddefce1fd8494862bdd WatchSource:0}: Error finding container 650009cf3d50b7ce7b73d2959741ef4fb99d5e9a25abfddefce1fd8494862bdd: Status 404 returned error can't find the container with id 650009cf3d50b7ce7b73d2959741ef4fb99d5e9a25abfddefce1fd8494862bdd Jul 02 19:57:51.893294 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:51.892959 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bpw2q"] Jul 02 19:57:51.895112 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:51.895085 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d335f2e_9978_4088_ad57_c429506e14e0.slice/crio-e838420530d5b97187d906a5fcebfb35b7b112797f771df9207f61759d454650 WatchSource:0}: Error finding container e838420530d5b97187d906a5fcebfb35b7b112797f771df9207f61759d454650: Status 404 returned error can't find the container with id e838420530d5b97187d906a5fcebfb35b7b112797f771df9207f61759d454650 Jul 02 19:57:52.008661 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.008618 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:52.150403 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.150368 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" event={"ID":"c69fba04-e867-40b6-a59e-0ef76343f44b","Type":"ContainerStarted","Data":"6245593178e5b2ada7db0896bec3925cefd789c577884dfefea318cadbc7b62e"} Jul 02 19:57:52.150767 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.150430 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" event={"ID":"c69fba04-e867-40b6-a59e-0ef76343f44b","Type":"ContainerStarted","Data":"87350305a80000b09f15605a0cec9b1b66e71953c95b08aef5520e443b43c877"} Jul 02 19:57:52.151781 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.151756 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d94cr" event={"ID":"f32689c2-77ec-4790-8d1d-448d6f7af76c","Type":"ContainerStarted","Data":"650009cf3d50b7ce7b73d2959741ef4fb99d5e9a25abfddefce1fd8494862bdd"} Jul 02 19:57:52.152843 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.152822 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpw2q" event={"ID":"6d335f2e-9978-4088-ad57-c429506e14e0","Type":"ContainerStarted","Data":"e838420530d5b97187d906a5fcebfb35b7b112797f771df9207f61759d454650"} Jul 02 19:57:52.153834 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.153814 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ts6nm" event={"ID":"d325dfc6-0226-40f2-91bd-6ec23f095948","Type":"ContainerStarted","Data":"6646ca8fabdb530d83d6a201c5f90160c8d6e8892a8bceb68609d6d97000d4c6"} Jul 02 19:57:52.171267 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:52.171228 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x2z86" podStartSLOduration=2.872620356 podStartE2EDuration="4.171215994s" totalImagesPullingTime="1.298595638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:52.170028992 +0000 UTC m=+66.900471408" watchObservedRunningTime="2026-07-02 19:57:52.171215994 +0000 UTC m=+66.901658399" Jul 02 19:57:53.164974 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:53.164936 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpw2q" event={"ID":"6d335f2e-9978-4088-ad57-c429506e14e0","Type":"ContainerStarted","Data":"f6982742b4960512e8c57d98cbaedc60709e864578b98d3e32d0d06ba70ae807"} Jul 02 19:57:53.165398 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:53.164994 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bpw2q" event={"ID":"6d335f2e-9978-4088-ad57-c429506e14e0","Type":"ContainerStarted","Data":"daf9c4df6766329c030fe7168ffb6754eea19c6fec1f24b64533489ab004b382"} Jul 02 19:57:53.188615 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:53.188520 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bpw2q" podStartSLOduration=66.150400533 podStartE2EDuration="1m7.188498584s" totalImagesPullingTime="1.038098051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:53.187285433 +0000 UTC m=+67.917727841" watchObservedRunningTime="2026-07-02 19:57:53.188498584 +0000 UTC m=+67.918940994" Jul 02 19:57:53.293560 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:53.293521 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:53.392320 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:53.392283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:53.927843 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:53.927803 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.154008 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.153947 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.181339 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.181260 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn"] Jul 02 19:57:54.203066 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.203037 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn"] Jul 02 19:57:54.203208 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.203137 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.208106 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.208070 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 19:57:54.208555 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.208355 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f86rk\"" Jul 02 19:57:54.208626 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.208593 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:57:54.238213 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.238136 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5bhk\" (UniqueName: \"kubernetes.io/projected/b4af67dd-880a-4265-ae74-25900e961689-kube-api-access-d5bhk\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.238787 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.238222 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4af67dd-880a-4265-ae74-25900e961689-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.238787 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.238281 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4af67dd-880a-4265-ae74-25900e961689-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.238787 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.238335 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4af67dd-880a-4265-ae74-25900e961689-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.256025 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.255997 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx"] Jul 02 19:57:54.271136 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.271112 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.273678 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.273655 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g2mh8"] Jul 02 19:57:54.274713 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.274526 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 19:57:54.274713 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.274526 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-txpzt\"" Jul 02 19:57:54.274713 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.274653 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 19:57:54.280767 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.280738 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 19:57:54.295278 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.295243 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx"] Jul 02 19:57:54.295427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.295366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.299099 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.299076 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 19:57:54.299661 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.299639 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qvx5c\"" Jul 02 19:57:54.304609 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.304588 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 19:57:54.304701 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.304650 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 19:57:54.312488 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.312435 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.338799 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-sys\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.338842 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4af67dd-880a-4265-ae74-25900e961689-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.338899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhk\" (UniqueName: \"kubernetes.io/projected/b4af67dd-880a-4265-ae74-25900e961689-kube-api-access-d5bhk\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.338925 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-textfile\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.338968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.338997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-tls\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ae9b380-de57-48ac-a8a9-3da847b1c75a-metrics-client-ca\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339082 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4af67dd-880a-4265-ae74-25900e961689-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.339165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339128 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d684c44-d41a-4dea-a330-217244b3e444-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hccw6\" (UniqueName: \"kubernetes.io/projected/4ae9b380-de57-48ac-a8a9-3da847b1c75a-kube-api-access-hccw6\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339785 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d684c44-d41a-4dea-a330-217244b3e444-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-root\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339940 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsg2w\" (UniqueName: \"kubernetes.io/projected/6d684c44-d41a-4dea-a330-217244b3e444-kube-api-access-dsg2w\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.339960 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4af67dd-880a-4265-ae74-25900e961689-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.340012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4af67dd-880a-4265-ae74-25900e961689-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.340563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.340234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-wtmp\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.343186 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.342852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4af67dd-880a-4265-ae74-25900e961689-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.343186 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.343034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4af67dd-880a-4265-ae74-25900e961689-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.359121 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.359098 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5bhk\" (UniqueName: \"kubernetes.io/projected/b4af67dd-880a-4265-ae74-25900e961689-kube-api-access-d5bhk\") pod \"openshift-state-metrics-54cf96dfcf-frxgn\" (UID: \"b4af67dd-880a-4265-ae74-25900e961689\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.417430 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.417393 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.441382 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.441382 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d684c44-d41a-4dea-a330-217244b3e444-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.441382 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hccw6\" (UniqueName: \"kubernetes.io/projected/4ae9b380-de57-48ac-a8a9-3da847b1c75a-kube-api-access-hccw6\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441466 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d684c44-d41a-4dea-a330-217244b3e444-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-root\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsg2w\" (UniqueName: \"kubernetes.io/projected/6d684c44-d41a-4dea-a330-217244b3e444-kube-api-access-dsg2w\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441566 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-wtmp\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.441619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441599 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-sys\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442029 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441632 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-textfile\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442029 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442029 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:54.441680 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 19:57:54.442029 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:57:54.441748 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-tls podName:6d684c44-d41a-4dea-a330-217244b3e444 nodeName:}" failed. No retries permitted until 2026-07-02 19:57:54.941722771 +0000 UTC m=+69.672165175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-dqrrx" (UID: "6d684c44-d41a-4dea-a330-217244b3e444") : secret "kube-state-metrics-tls" not found Jul 02 19:57:54.442029 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441982 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-wtmp\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442029 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.441681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-tls\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442341 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442036 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-root\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442341 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442086 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ae9b380-de57-48ac-a8a9-3da847b1c75a-metrics-client-ca\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442341 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d684c44-d41a-4dea-a330-217244b3e444-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.442341 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442138 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.442341 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442223 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ae9b380-de57-48ac-a8a9-3da847b1c75a-sys\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442574 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442425 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-textfile\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442634 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ae9b380-de57-48ac-a8a9-3da847b1c75a-metrics-client-ca\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.442696 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.442673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d684c44-d41a-4dea-a330-217244b3e444-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.443166 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.443122 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.444434 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.444391 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.444758 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.444737 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.444914 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.444868 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ae9b380-de57-48ac-a8a9-3da847b1c75a-node-exporter-tls\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.450800 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.450782 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsg2w\" (UniqueName: \"kubernetes.io/projected/6d684c44-d41a-4dea-a330-217244b3e444-kube-api-access-dsg2w\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.451696 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.451671 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hccw6\" (UniqueName: \"kubernetes.io/projected/4ae9b380-de57-48ac-a8a9-3da847b1c75a-kube-api-access-hccw6\") pod \"node-exporter-g2mh8\" (UID: \"4ae9b380-de57-48ac-a8a9-3da847b1c75a\") " pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.516249 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.516188 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" Jul 02 19:57:54.560370 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.560315 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.605702 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.605613 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g2mh8" Jul 02 19:57:54.677810 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.677775 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.942595 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.942559 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:54.945534 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.945499 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:54.947993 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:54.947970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d684c44-d41a-4dea-a330-217244b3e444-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-dqrrx\" (UID: \"6d684c44-d41a-4dea-a330-217244b3e444\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:55.147393 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.147357 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:55.182626 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.182593 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" Jul 02 19:57:55.249629 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.249593 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:55.336083 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.336035 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:57:55.339175 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.339152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.342394 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342366 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342605 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342654 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342675 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342808 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342919 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5qxp7\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.342989 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.343001 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.343109 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 19:57:55.343295 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.343138 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 19:57:55.346493 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.345461 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:55.357944 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.357921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:57:55.449250 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449420 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449261 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449420 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-web-config\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449420 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449384 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449571 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449571 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449464 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449571 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g85vb\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-kube-api-access-g85vb\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449571 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-out\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449673 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.449793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.450104 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.449808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.450539 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.450501 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:55.550715 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.550678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.550943 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.550732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.550943 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.550778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.550943 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.550806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551130 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.550956 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-web-config\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551130 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551011 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551130 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551130 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551086 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551130 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g85vb\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-kube-api-access-g85vb\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-out\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.551945 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.551598 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.552468 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.552126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.552923 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.552894 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.554103 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.554051 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.554498 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.554477 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-out\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.555065 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.555045 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.555203 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.555103 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.555483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.555432 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.555810 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.555698 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.555980 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.555945 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.556282 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.556238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-web-config\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.557237 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.557215 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.562459 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.562437 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g85vb\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-kube-api-access-g85vb\") pod \"alertmanager-main-0\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.657994 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.657960 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:57:55.934934 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.934848 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:55.934934 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.934916 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:55.940119 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:55.940095 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:56.122649 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:56.122618 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mkx7d" Jul 02 19:57:56.182661 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:56.182630 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:57:56.913698 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:56.913657 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae9b380_de57_48ac_a8a9_3da847b1c75a.slice/crio-579cd53cb60bb3643426cae0e5ae70e3b4efd4b8011c979c595532bce3703277 WatchSource:0}: Error finding container 579cd53cb60bb3643426cae0e5ae70e3b4efd4b8011c979c595532bce3703277: Status 404 returned error can't find the container with id 579cd53cb60bb3643426cae0e5ae70e3b4efd4b8011c979c595532bce3703277 Jul 02 19:57:57.075612 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.075591 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx"] Jul 02 19:57:57.078704 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:57.078676 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d684c44_d41a_4dea_a330_217244b3e444.slice/crio-82fbf66c2142d363c98e2ed141008fbdcdaf29ccf00887a09a2ead89401c5517 WatchSource:0}: Error finding container 82fbf66c2142d363c98e2ed141008fbdcdaf29ccf00887a09a2ead89401c5517: Status 404 returned error can't find the container with id 82fbf66c2142d363c98e2ed141008fbdcdaf29ccf00887a09a2ead89401c5517 Jul 02 19:57:57.132056 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.131955 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:57.182235 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.182146 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" event={"ID":"6d684c44-d41a-4dea-a330-217244b3e444","Type":"ContainerStarted","Data":"82fbf66c2142d363c98e2ed141008fbdcdaf29ccf00887a09a2ead89401c5517"} Jul 02 19:57:57.183887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.183843 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d94cr" event={"ID":"f32689c2-77ec-4790-8d1d-448d6f7af76c","Type":"ContainerStarted","Data":"0677eb2e8397843402fb97b8411a7cfe6643a24e9459a83b72ba63a288c0396e"} Jul 02 19:57:57.185508 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.185478 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ts6nm" event={"ID":"d325dfc6-0226-40f2-91bd-6ec23f095948","Type":"ContainerStarted","Data":"fc26e962ec2e93ca9171d4a1d746598dd6d1fafbc1d2a1bf71aa92c827be5838"} Jul 02 19:57:57.186742 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.186715 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2mh8" event={"ID":"4ae9b380-de57-48ac-a8a9-3da847b1c75a","Type":"ContainerStarted","Data":"579cd53cb60bb3643426cae0e5ae70e3b4efd4b8011c979c595532bce3703277"} Jul 02 19:57:57.205371 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.205311 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d94cr" podStartSLOduration=66.171542454 podStartE2EDuration="1m11.205291146s" totalImagesPullingTime="5.033748692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:57.203225146 +0000 UTC m=+71.933667554" watchObservedRunningTime="2026-07-02 19:57:57.205291146 +0000 UTC m=+71.935733549" Jul 02 19:57:57.214485 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.214445 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:57.216947 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.216925 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56c54d855f-jj9jk"] Jul 02 19:57:57.219490 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.219475 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.222263 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222235 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 19:57:57.222506 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222490 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 19:57:57.222591 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222552 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 19:57:57.222642 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222601 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1qd7k6a1ilb7d\"" Jul 02 19:57:57.222695 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222680 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 19:57:57.222781 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222765 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 19:57:57.222954 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.222939 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vjk8p\"" Jul 02 19:57:57.231145 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.231106 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ts6nm" podStartSLOduration=66.159416642 podStartE2EDuration="1m11.231093435s" totalImagesPullingTime="5.071676793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:57.22952994 +0000 UTC m=+71.959972347" watchObservedRunningTime="2026-07-02 19:57:57.231093435 +0000 UTC m=+71.961535841" Jul 02 19:57:57.238197 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.238173 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56c54d855f-jj9jk"] Jul 02 19:57:57.266572 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.266545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-grpc-tls\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.266705 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.266596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.266770 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.266705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-metrics-client-ca\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.266821 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.266768 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2sq4\" (UniqueName: \"kubernetes.io/projected/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-kube-api-access-j2sq4\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.266966 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.266929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.267083 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.267059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.267154 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.267130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.267200 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.267165 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-tls\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.300665 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.300577 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn"] Jul 02 19:57:57.302717 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:57.302694 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4af67dd_880a_4265_ae74_25900e961689.slice/crio-c888b7de76f0b8df1f74e200fed08a6ab60dece10bde0a0f4e399824c21b7260 WatchSource:0}: Error finding container c888b7de76f0b8df1f74e200fed08a6ab60dece10bde0a0f4e399824c21b7260: Status 404 returned error can't find the container with id c888b7de76f0b8df1f74e200fed08a6ab60dece10bde0a0f4e399824c21b7260 Jul 02 19:57:57.309123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.309103 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:57:57.310759 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:57.310735 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733b7c24_15bb_45e5_b8b1_65809bfd8b8f.slice/crio-7c62081f26e32e919a2fffb2b35e1a9b3cd44c77425fe834f8866ca04fb9b277 WatchSource:0}: Error finding container 7c62081f26e32e919a2fffb2b35e1a9b3cd44c77425fe834f8866ca04fb9b277: Status 404 returned error can't find the container with id 7c62081f26e32e919a2fffb2b35e1a9b3cd44c77425fe834f8866ca04fb9b277 Jul 02 19:57:57.367520 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367497 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-metrics-client-ca\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367596 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2sq4\" (UniqueName: \"kubernetes.io/projected/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-kube-api-access-j2sq4\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367649 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367701 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367765 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367765 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367729 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-tls\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367862 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367765 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-grpc-tls\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.367862 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.367814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.368312 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.368268 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-metrics-client-ca\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.370819 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.370776 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.371622 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.371580 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-grpc-tls\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.373026 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.372246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-tls\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.373026 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.372986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.373668 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.373645 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.374123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.374100 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.376435 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.376414 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2sq4\" (UniqueName: \"kubernetes.io/projected/be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907-kube-api-access-j2sq4\") pod \"thanos-querier-56c54d855f-jj9jk\" (UID: \"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907\") " pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.391666 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.391610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:57.528522 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.528492 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:57:57.547721 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.547681 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:57.872966 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:57.872857 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56c54d855f-jj9jk"] Jul 02 19:57:57.877226 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:57.877200 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4a6dc5_1f6e_4e48_9ceb_61e09bdcf907.slice/crio-871cf726c52fb822bebb10fd21ddff6d28db1d8b10175010d7178fd052d7e95f WatchSource:0}: Error finding container 871cf726c52fb822bebb10fd21ddff6d28db1d8b10175010d7178fd052d7e95f: Status 404 returned error can't find the container with id 871cf726c52fb822bebb10fd21ddff6d28db1d8b10175010d7178fd052d7e95f Jul 02 19:57:58.194286 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.194196 2555 generic.go:356] "Generic (PLEG): container finished" podID="4ae9b380-de57-48ac-a8a9-3da847b1c75a" containerID="719a990665b82d2800f41a344e16a67e013c1f373d6ccde1d2b533e22da9ceae" exitCode=0 Jul 02 19:57:58.194808 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.194294 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2mh8" event={"ID":"4ae9b380-de57-48ac-a8a9-3da847b1c75a","Type":"ContainerDied","Data":"719a990665b82d2800f41a344e16a67e013c1f373d6ccde1d2b533e22da9ceae"} Jul 02 19:57:58.195967 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.195930 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"871cf726c52fb822bebb10fd21ddff6d28db1d8b10175010d7178fd052d7e95f"} Jul 02 19:57:58.199490 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.199379 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" event={"ID":"b4af67dd-880a-4265-ae74-25900e961689","Type":"ContainerStarted","Data":"af1a9f304f52b736c35a2d2bf546d77e922e94b2ac7eee6658505d752dd8f861"} Jul 02 19:57:58.199490 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.199446 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" event={"ID":"b4af67dd-880a-4265-ae74-25900e961689","Type":"ContainerStarted","Data":"2ffe0be66a0d73b16acc1c03cf50d1eba92dd36866cd3aa26911d9581e666dbb"} Jul 02 19:57:58.199490 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.199472 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" event={"ID":"b4af67dd-880a-4265-ae74-25900e961689","Type":"ContainerStarted","Data":"c888b7de76f0b8df1f74e200fed08a6ab60dece10bde0a0f4e399824c21b7260"} Jul 02 19:57:58.201667 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.201636 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"7c62081f26e32e919a2fffb2b35e1a9b3cd44c77425fe834f8866ca04fb9b277"} Jul 02 19:57:58.202184 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.202162 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:57:58.393939 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.393901 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:58.457600 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.457509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:58.726401 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.726332 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6"] Jul 02 19:57:58.728618 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.728595 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.733287 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.733250 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 19:57:58.733287 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.733287 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 19:57:58.733547 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.733302 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 19:57:58.733547 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.733427 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 19:57:58.733653 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.733557 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qsvl6\"" Jul 02 19:57:58.734566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.734545 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-80hgeoj3plh56\"" Jul 02 19:57:58.743436 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.743416 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6"] Jul 02 19:57:58.780563 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/932b8b9c-8ad5-4d09-aa86-09b8c39de330-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.780727 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780588 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-secret-metrics-server-tls\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.780727 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/932b8b9c-8ad5-4d09-aa86-09b8c39de330-audit-log\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.780727 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-client-ca-bundle\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.780727 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/932b8b9c-8ad5-4d09-aa86-09b8c39de330-metrics-server-audit-profiles\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.780959 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hntnj\" (UniqueName: \"kubernetes.io/projected/932b8b9c-8ad5-4d09-aa86-09b8c39de330-kube-api-access-hntnj\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.780959 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.780807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-secret-metrics-server-client-certs\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/932b8b9c-8ad5-4d09-aa86-09b8c39de330-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882106 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-secret-metrics-server-tls\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882151 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/932b8b9c-8ad5-4d09-aa86-09b8c39de330-audit-log\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-client-ca-bundle\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882257 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/932b8b9c-8ad5-4d09-aa86-09b8c39de330-metrics-server-audit-profiles\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hntnj\" (UniqueName: \"kubernetes.io/projected/932b8b9c-8ad5-4d09-aa86-09b8c39de330-kube-api-access-hntnj\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.882723 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-secret-metrics-server-client-certs\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.883259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.882822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/932b8b9c-8ad5-4d09-aa86-09b8c39de330-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.883259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.883191 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/932b8b9c-8ad5-4d09-aa86-09b8c39de330-audit-log\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.883462 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.883404 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/932b8b9c-8ad5-4d09-aa86-09b8c39de330-metrics-server-audit-profiles\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.885442 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.885406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-secret-metrics-server-client-certs\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.885551 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.885443 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-client-ca-bundle\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.885617 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.885565 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/932b8b9c-8ad5-4d09-aa86-09b8c39de330-secret-metrics-server-tls\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.892916 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.891869 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hntnj\" (UniqueName: \"kubernetes.io/projected/932b8b9c-8ad5-4d09-aa86-09b8c39de330-kube-api-access-hntnj\") pod \"metrics-server-7df9f6dcf4-8rxt6\" (UID: \"932b8b9c-8ad5-4d09-aa86-09b8c39de330\") " pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:58.956466 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.956395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:58.964602 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.964548 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd"] Jul 02 19:57:58.968038 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.968013 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:58.970957 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.970895 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 19:57:58.971070 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.971031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ht5gb\"" Jul 02 19:57:58.976922 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:58.976824 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd"] Jul 02 19:57:59.041113 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.041087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:57:59.051528 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.051493 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:59.083835 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.083769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbvw\" (UniqueName: \"kubernetes.io/projected/b5dce658-813b-49f5-9872-8a38155d9b13-kube-api-access-zmbvw\") pod \"monitoring-plugin-d5dcff7cf-z69gd\" (UID: \"b5dce658-813b-49f5-9872-8a38155d9b13\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.083835 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.083827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b5dce658-813b-49f5-9872-8a38155d9b13-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z69gd\" (UID: \"b5dce658-813b-49f5-9872-8a38155d9b13\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.151385 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.151294 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:57:59.184863 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.184410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbvw\" (UniqueName: \"kubernetes.io/projected/b5dce658-813b-49f5-9872-8a38155d9b13-kube-api-access-zmbvw\") pod \"monitoring-plugin-d5dcff7cf-z69gd\" (UID: \"b5dce658-813b-49f5-9872-8a38155d9b13\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.184863 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.184477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b5dce658-813b-49f5-9872-8a38155d9b13-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z69gd\" (UID: \"b5dce658-813b-49f5-9872-8a38155d9b13\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.190018 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.189971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b5dce658-813b-49f5-9872-8a38155d9b13-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z69gd\" (UID: \"b5dce658-813b-49f5-9872-8a38155d9b13\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.194003 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.193950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbvw\" (UniqueName: \"kubernetes.io/projected/b5dce658-813b-49f5-9872-8a38155d9b13-kube-api-access-zmbvw\") pod \"monitoring-plugin-d5dcff7cf-z69gd\" (UID: \"b5dce658-813b-49f5-9872-8a38155d9b13\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.207728 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.207684 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" event={"ID":"6d684c44-d41a-4dea-a330-217244b3e444","Type":"ContainerStarted","Data":"ba33fe97f5ef9ec73d8bb9f36681e7b64b5df977b58d16db44ae01a8a5f49867"} Jul 02 19:57:59.214317 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.214279 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" event={"ID":"b4af67dd-880a-4265-ae74-25900e961689","Type":"ContainerStarted","Data":"0b21d8c9159265d722ca06602ce8d616c236b9039489f23e09ba2db66d2ea054"} Jul 02 19:57:59.216806 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.216724 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255"} Jul 02 19:57:59.220606 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.220271 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2mh8" event={"ID":"4ae9b380-de57-48ac-a8a9-3da847b1c75a","Type":"ContainerStarted","Data":"41276b443ad0dcb86a6b1560e79eb95a8dcec13927c54492244aa8d327627109"} Jul 02 19:57:59.224551 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.224497 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6"] Jul 02 19:57:59.281455 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.280788 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:57:59.281455 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:59.281081 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod932b8b9c_8ad5_4d09_aa86_09b8c39de330.slice/crio-b277d1420dd1517d805320529243ef17370efe495b021914b83aeeb13934cd43 WatchSource:0}: Error finding container b277d1420dd1517d805320529243ef17370efe495b021914b83aeeb13934cd43: Status 404 returned error can't find the container with id b277d1420dd1517d805320529243ef17370efe495b021914b83aeeb13934cd43 Jul 02 19:57:59.464142 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.464058 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frxgn" podStartSLOduration=3.838189481 podStartE2EDuration="5.464033656s" totalImagesPullingTime="1.625844175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:59.28543028 +0000 UTC m=+74.015872711" watchObservedRunningTime="2026-07-02 19:57:59.464033656 +0000 UTC m=+74.194476062" Jul 02 19:57:59.464525 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.464506 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd"] Jul 02 19:57:59.468288 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:57:59.468259 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5dce658_813b_49f5_9872_8a38155d9b13.slice/crio-014a1664ce3e2e791d5ae7abcaf269f742e880bcc5fc4a2f624e012c9c6cf890 WatchSource:0}: Error finding container 014a1664ce3e2e791d5ae7abcaf269f742e880bcc5fc4a2f624e012c9c6cf890: Status 404 returned error can't find the container with id 014a1664ce3e2e791d5ae7abcaf269f742e880bcc5fc4a2f624e012c9c6cf890 Jul 02 19:57:59.901931 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.901818 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:59.901931 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.901901 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:57:59.907932 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:57:59.907906 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:58:00.228481 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.228387 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" event={"ID":"6d684c44-d41a-4dea-a330-217244b3e444","Type":"ContainerStarted","Data":"de4731c98e815ba14aec2fe190eececd3f9a2307365094cf8dbec2227ce39f39"} Jul 02 19:58:00.228481 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.228459 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" event={"ID":"6d684c44-d41a-4dea-a330-217244b3e444","Type":"ContainerStarted","Data":"27bc88137b2ecd18e9c60f65440471a7c1d66433fbbdf60d21242f2f02f1bb9d"} Jul 02 19:58:00.230417 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.230381 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255" exitCode=0 Jul 02 19:58:00.230793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.230709 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255"} Jul 02 19:58:00.241291 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.241255 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g2mh8" event={"ID":"4ae9b380-de57-48ac-a8a9-3da847b1c75a","Type":"ContainerStarted","Data":"bd873fd655de0c274d5fd34d32ccc26f00432d3f470ccd3592d78603d28cf646"} Jul 02 19:58:00.245440 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.245389 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" event={"ID":"b5dce658-813b-49f5-9872-8a38155d9b13","Type":"ContainerStarted","Data":"014a1664ce3e2e791d5ae7abcaf269f742e880bcc5fc4a2f624e012c9c6cf890"} Jul 02 19:58:00.247408 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.247385 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" event={"ID":"932b8b9c-8ad5-4d09-aa86-09b8c39de330","Type":"ContainerStarted","Data":"b277d1420dd1517d805320529243ef17370efe495b021914b83aeeb13934cd43"} Jul 02 19:58:00.253093 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.251808 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-dqrrx" podStartSLOduration=4.271461292 podStartE2EDuration="6.251755082s" totalImagesPullingTime="1.98029379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:00.24980197 +0000 UTC m=+74.980244388" watchObservedRunningTime="2026-07-02 19:58:00.251755082 +0000 UTC m=+74.982197489" Jul 02 19:58:00.258913 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.258888 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:58:00.312565 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.312508 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g2mh8" podStartSLOduration=5.386987443 podStartE2EDuration="6.31248638s" totalImagesPullingTime="855.393272ms" totalInitContainerRuntime="70.105665ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:00.311193685 +0000 UTC m=+75.041636093" watchObservedRunningTime="2026-07-02 19:58:00.31248638 +0000 UTC m=+75.042928818" Jul 02 19:58:00.366049 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.365983 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5487c69d-8jdld"] Jul 02 19:58:00.467121 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.467088 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:58:00.473743 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.471339 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.474764 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.474736 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 19:58:00.474939 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.474861 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 19:58:00.474939 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.474898 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k2fpx\"" Jul 02 19:58:00.474939 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.474918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 19:58:00.475115 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.475011 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 19:58:00.476369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.476344 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 19:58:00.476510 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.476488 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 19:58:00.476573 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.476561 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 19:58:00.476826 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.476684 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 19:58:00.476826 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.476712 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 19:58:00.476826 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.476743 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 19:58:00.477063 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.477030 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bqa6sqkqqs5og\"" Jul 02 19:58:00.477266 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.477233 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 19:58:00.477606 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.477438 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 19:58:00.481996 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.481921 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 19:58:00.482809 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.482658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:00.484559 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.484500 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 19:58:00.492245 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.492213 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:58:00.599611 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599611 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599865 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599865 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkvph\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-kube-api-access-wkvph\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599865 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599741 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599865 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599865 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-config-out\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.599865 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.599982 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600056 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-web-config\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-config\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600117 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600136 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600201 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600720 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600209 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600720 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.600720 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.600282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.701753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-config-out\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.701815 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.701845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.701871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.701909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702356 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.701945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-web-config\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702431 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-config\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702456 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702581 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.702776 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702757 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkvph\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-kube-api-access-wkvph\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.703387 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702792 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.703387 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.702823 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.703387 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.703369 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.703562 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.703535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.704212 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.703918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.705164 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.704891 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.706108 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.705940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.709724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.706767 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.709724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.707024 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.709724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.708649 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.709724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.709682 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.710673 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.710632 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.712674 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.712649 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.712758 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.712713 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.712961 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.712827 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-config-out\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.714793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.714325 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.714793 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.714744 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-config\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.715045 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.715022 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-web-config\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.715705 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.715682 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.716359 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.716306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.716888 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.716821 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.717629 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.717605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkvph\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-kube-api-access-wkvph\") pod \"prometheus-k8s-0\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:00.787859 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:00.787825 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:01.108041 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.108015 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:58:01.113124 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:58:01.113095 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85784e60_9a7a_4435_bc52_8e9588fd1425.slice/crio-941992ed7bf099c167880984efcc0748801cc5f253edb85c309aa0a811bd4c20 WatchSource:0}: Error finding container 941992ed7bf099c167880984efcc0748801cc5f253edb85c309aa0a811bd4c20: Status 404 returned error can't find the container with id 941992ed7bf099c167880984efcc0748801cc5f253edb85c309aa0a811bd4c20 Jul 02 19:58:01.264078 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.263817 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"2af27911e93b148535ded6b05ad14dba840ae0e91aa6323515d09ce1dd6cea81"} Jul 02 19:58:01.264078 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.263971 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"95e597458b6b46764096ce439a1354feb902556ee3560e8f0101fd5e91157cd1"} Jul 02 19:58:01.264078 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.264017 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"b62b7a7b7cdffb3e1bb7cf85e9a4b4015077b69e10d56bac2d09959d288fe22e"} Jul 02 19:58:01.267674 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.267645 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef"} Jul 02 19:58:01.267790 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.267721 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"941992ed7bf099c167880984efcc0748801cc5f253edb85c309aa0a811bd4c20"} Jul 02 19:58:01.276781 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.276750 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" event={"ID":"932b8b9c-8ad5-4d09-aa86-09b8c39de330","Type":"ContainerStarted","Data":"59ddb05c258589e92a00326493a03210afcf0f53c0449b3eaa7b0f454377cc74"} Jul 02 19:58:01.340495 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.339461 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" podStartSLOduration=1.62968057 podStartE2EDuration="3.339436612s" totalImagesPullingTime="1.709756042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:01.338815253 +0000 UTC m=+76.069257659" watchObservedRunningTime="2026-07-02 19:58:01.339436612 +0000 UTC m=+76.069879019" Jul 02 19:58:01.631037 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.630899 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:01.731967 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.731925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:01.930253 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:01.930131 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:02.030275 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.030235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:02.295790 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.295738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" event={"ID":"b5dce658-813b-49f5-9872-8a38155d9b13","Type":"ContainerStarted","Data":"d9900c6fe75732abc95a70ece23493f95107c8969107bf5e37d6e343999e9c70"} Jul 02 19:58:02.296275 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.296005 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:58:02.299694 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.299577 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef" exitCode=0 Jul 02 19:58:02.299808 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.299686 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef"} Jul 02 19:58:02.307851 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.307826 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" Jul 02 19:58:02.315373 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.315315 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z69gd" podStartSLOduration=1.974692474 podStartE2EDuration="4.315296753s" totalImagesPullingTime="2.340604279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:02.31353593 +0000 UTC m=+77.043978337" watchObservedRunningTime="2026-07-02 19:58:02.315296753 +0000 UTC m=+77.045739159" Jul 02 19:58:02.607911 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.607825 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:02.705489 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:02.705456 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:03.250620 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.250590 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:03.306757 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.306724 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"5ff52583160091328a9faa19920c7939fab0f77df3448914505dedbccf2c9f4a"} Jul 02 19:58:03.307218 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.306804 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:58:03.307218 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.306840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"daf0aab7bbb33ef5212b4f4e926ed487f21717dab15986bdec9b58674313fb8a"} Jul 02 19:58:03.307218 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.306895 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" event={"ID":"be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907","Type":"ContainerStarted","Data":"86e7ea24bfad2e2b2c901784e6ae8925b870a7180e7e329f870fee883082b6d8"} Jul 02 19:58:03.309944 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.309917 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b"} Jul 02 19:58:03.310057 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.309977 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032"} Jul 02 19:58:03.310057 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.310007 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39"} Jul 02 19:58:03.310057 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.310030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58"} Jul 02 19:58:03.310057 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.310053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b"} Jul 02 19:58:03.310232 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.310076 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerStarted","Data":"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9"} Jul 02 19:58:03.322077 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.322054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:03.333384 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.333344 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" podStartSLOduration=2.024003839 podStartE2EDuration="6.333330475s" totalImagesPullingTime="4.309326636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:03.331355285 +0000 UTC m=+78.061797732" watchObservedRunningTime="2026-07-02 19:58:03.333330475 +0000 UTC m=+78.063772881" Jul 02 19:58:03.363365 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.363316 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.351212223 podStartE2EDuration="8.36329766s" totalImagesPullingTime="3.991710653s" totalInitContainerRuntime="20.374784ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:03.361904418 +0000 UTC m=+78.092346828" watchObservedRunningTime="2026-07-02 19:58:03.36329766 +0000 UTC m=+78.093740068" Jul 02 19:58:03.907420 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:03.907374 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:04.005464 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:04.005423 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:05.445348 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:05.445310 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:05.535604 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:05.535568 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:06.328008 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.327929 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9"} Jul 02 19:58:06.328008 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.327996 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00"} Jul 02 19:58:06.328173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.328024 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e"} Jul 02 19:58:06.328173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.328054 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113"} Jul 02 19:58:06.328173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.328082 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801"} Jul 02 19:58:06.328173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.328107 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerStarted","Data":"455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d"} Jul 02 19:58:06.365030 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:06.364974 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.898314103 podStartE2EDuration="6.364955794s" totalImagesPullingTime="3.434660732s" totalInitContainerRuntime="31.980959ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:58:06.362389224 +0000 UTC m=+81.092831630" watchObservedRunningTime="2026-07-02 19:58:06.364955794 +0000 UTC m=+81.095398201" Jul 02 19:58:08.175761 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:08.175626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:08.244398 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:08.244363 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:09.321418 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:09.321391 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56c54d855f-jj9jk" Jul 02 19:58:10.789259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:10.789231 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:58:10.946325 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:10.946298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:11.041443 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:11.041339 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:13.334614 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:13.334582 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f45f95454-l2nkv"] Jul 02 19:58:13.473608 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:13.473577 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:13.574607 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:13.574572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:13.633353 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:13.633252 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:14.452069 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:14.452035 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:14.551818 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:14.551789 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:16.621642 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:16.621610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:18.218157 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:18.218124 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:18.285436 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:18.285404 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:19.042411 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:19.042371 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:58:19.042576 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:19.042457 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:58:25.392268 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.392229 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d5487c69d-8jdld" podUID="e4f23017-80ee-40d9-8cbf-8bd72a22d809" containerName="console" containerID="cri-o://bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb" gracePeriod=15 Jul 02 19:58:25.630026 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.630002 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:58:25.734259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734168 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-config\") pod \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " Jul 02 19:58:25.734259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734227 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-service-ca\") pod \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " Jul 02 19:58:25.734259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734258 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-oauth-serving-cert\") pod \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " Jul 02 19:58:25.734522 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734277 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-oauth-config\") pod \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " Jul 02 19:58:25.734522 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734299 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6q59\" (UniqueName: \"kubernetes.io/projected/e4f23017-80ee-40d9-8cbf-8bd72a22d809-kube-api-access-c6q59\") pod \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " Jul 02 19:58:25.734522 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734324 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-serving-cert\") pod \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\" (UID: \"e4f23017-80ee-40d9-8cbf-8bd72a22d809\") " Jul 02 19:58:25.734717 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734690 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-config" (OuterVolumeSpecName: "console-config") pod "e4f23017-80ee-40d9-8cbf-8bd72a22d809" (UID: "e4f23017-80ee-40d9-8cbf-8bd72a22d809"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:25.734761 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734702 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4f23017-80ee-40d9-8cbf-8bd72a22d809" (UID: "e4f23017-80ee-40d9-8cbf-8bd72a22d809"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:25.734913 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.734863 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4f23017-80ee-40d9-8cbf-8bd72a22d809" (UID: "e4f23017-80ee-40d9-8cbf-8bd72a22d809"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:25.736728 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.736694 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f23017-80ee-40d9-8cbf-8bd72a22d809-kube-api-access-c6q59" (OuterVolumeSpecName: "kube-api-access-c6q59") pod "e4f23017-80ee-40d9-8cbf-8bd72a22d809" (UID: "e4f23017-80ee-40d9-8cbf-8bd72a22d809"). InnerVolumeSpecName "kube-api-access-c6q59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:25.736728 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.736697 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4f23017-80ee-40d9-8cbf-8bd72a22d809" (UID: "e4f23017-80ee-40d9-8cbf-8bd72a22d809"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:58:25.736920 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.736756 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4f23017-80ee-40d9-8cbf-8bd72a22d809" (UID: "e4f23017-80ee-40d9-8cbf-8bd72a22d809"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:58:25.835000 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.834970 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:25.835000 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.834996 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:25.835000 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.835007 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4f23017-80ee-40d9-8cbf-8bd72a22d809-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:25.835260 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.835017 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:25.835260 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.835030 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6q59\" (UniqueName: \"kubernetes.io/projected/e4f23017-80ee-40d9-8cbf-8bd72a22d809-kube-api-access-c6q59\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:25.835260 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:25.835044 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4f23017-80ee-40d9-8cbf-8bd72a22d809-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:26.416897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.416845 2555 generic.go:356] "Generic (PLEG): container finished" podID="e4f23017-80ee-40d9-8cbf-8bd72a22d809" containerID="bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb" exitCode=0 Jul 02 19:58:26.417349 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.416922 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5487c69d-8jdld" Jul 02 19:58:26.417349 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.416931 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5487c69d-8jdld" event={"ID":"e4f23017-80ee-40d9-8cbf-8bd72a22d809","Type":"ContainerDied","Data":"bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb"} Jul 02 19:58:26.417349 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.417017 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5487c69d-8jdld" event={"ID":"e4f23017-80ee-40d9-8cbf-8bd72a22d809","Type":"ContainerDied","Data":"e992f76c267aff53d661934b1fb121b040a22a4df78b38cd493a7231cc628b6f"} Jul 02 19:58:26.417349 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.417051 2555 scope.go:117] "RemoveContainer" containerID="bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb" Jul 02 19:58:26.425262 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.425246 2555 scope.go:117] "RemoveContainer" containerID="bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb" Jul 02 19:58:26.425503 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:58:26.425485 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb\": container with ID starting with bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb not found: ID does not exist" containerID="bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb" Jul 02 19:58:26.425566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.425514 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb"} err="failed to get container status \"bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb\": rpc error: code = NotFound desc = could not find container \"bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb\": container with ID starting with bf39b20a818977dd6e572bfc441fcfb23a0f7e39ea85c3d8cc1310fcf00bdccb not found: ID does not exist" Jul 02 19:58:26.439165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.439144 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5487c69d-8jdld"] Jul 02 19:58:26.448730 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:26.448709 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d5487c69d-8jdld"] Jul 02 19:58:27.871181 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:27.871143 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4f23017-80ee-40d9-8cbf-8bd72a22d809" path="/var/lib/kubelet/pods/e4f23017-80ee-40d9-8cbf-8bd72a22d809/volumes" Jul 02 19:58:29.222548 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:29.222517 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d94cr" Jul 02 19:58:31.137791 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:31.137752 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:31.235995 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:31.235953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:33.216446 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:33.216401 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:33.285522 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:33.285488 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:58:38.360706 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.360660 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f45f95454-l2nkv" podUID="6dd1e11a-8ae6-4875-a46d-376abe841a2c" containerName="console" containerID="cri-o://06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571" gracePeriod=15 Jul 02 19:58:38.631344 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.631280 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:58:38.721264 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721237 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-service-ca\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721445 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721275 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-oauth-serving-cert\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721445 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721295 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-oauth-config\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721445 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721320 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-trusted-ca-bundle\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721622 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721470 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-config\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721622 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721514 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-serving-cert\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721622 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721562 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnzlx\" (UniqueName: \"kubernetes.io/projected/6dd1e11a-8ae6-4875-a46d-376abe841a2c-kube-api-access-xnzlx\") pod \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\" (UID: \"6dd1e11a-8ae6-4875-a46d-376abe841a2c\") " Jul 02 19:58:38.721773 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721725 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:38.721773 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721759 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-service-ca" (OuterVolumeSpecName: "service-ca") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:38.721862 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721827 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-service-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:38.721862 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721830 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-config" (OuterVolumeSpecName: "console-config") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:38.721961 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.721841 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-oauth-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:38.722020 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.722000 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:58:38.723574 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.723537 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:58:38.723695 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.723619 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:58:38.723766 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.723732 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd1e11a-8ae6-4875-a46d-376abe841a2c-kube-api-access-xnzlx" (OuterVolumeSpecName: "kube-api-access-xnzlx") pod "6dd1e11a-8ae6-4875-a46d-376abe841a2c" (UID: "6dd1e11a-8ae6-4875-a46d-376abe841a2c"). InnerVolumeSpecName "kube-api-access-xnzlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:58:38.823215 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.823185 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnzlx\" (UniqueName: \"kubernetes.io/projected/6dd1e11a-8ae6-4875-a46d-376abe841a2c-kube-api-access-xnzlx\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:38.823215 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.823210 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-oauth-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:38.823215 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.823220 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:38.823410 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.823228 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:38.823410 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:38.823237 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6dd1e11a-8ae6-4875-a46d-376abe841a2c-console-serving-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:58:39.046887 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.046851 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:58:39.050560 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.050534 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7df9f6dcf4-8rxt6" Jul 02 19:58:39.476123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.476021 2555 generic.go:356] "Generic (PLEG): container finished" podID="6dd1e11a-8ae6-4875-a46d-376abe841a2c" containerID="06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571" exitCode=0 Jul 02 19:58:39.476123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.476068 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f45f95454-l2nkv" Jul 02 19:58:39.476123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.476105 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f45f95454-l2nkv" event={"ID":"6dd1e11a-8ae6-4875-a46d-376abe841a2c","Type":"ContainerDied","Data":"06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571"} Jul 02 19:58:39.476687 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.476154 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f45f95454-l2nkv" event={"ID":"6dd1e11a-8ae6-4875-a46d-376abe841a2c","Type":"ContainerDied","Data":"134279ad40027b88205ad937aace82106fa139d7c971eaebb9ca5ee42cffade5"} Jul 02 19:58:39.476687 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.476181 2555 scope.go:117] "RemoveContainer" containerID="06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571" Jul 02 19:58:39.485449 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.485430 2555 scope.go:117] "RemoveContainer" containerID="06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571" Jul 02 19:58:39.485714 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:58:39.485697 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571\": container with ID starting with 06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571 not found: ID does not exist" containerID="06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571" Jul 02 19:58:39.485764 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.485722 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571"} err="failed to get container status \"06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571\": rpc error: code = NotFound desc = could not find container \"06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571\": container with ID starting with 06bf557d9bc9acac804775351ab47727f325aa7ed988ba6d8212ae8ce7613571 not found: ID does not exist" Jul 02 19:58:39.496767 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.496748 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f45f95454-l2nkv"] Jul 02 19:58:39.500510 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.500489 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f45f95454-l2nkv"] Jul 02 19:58:39.871360 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:58:39.871327 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd1e11a-8ae6-4875-a46d-376abe841a2c" path="/var/lib/kubelet/pods/6dd1e11a-8ae6-4875-a46d-376abe841a2c/volumes" Jul 02 19:59:00.788612 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:00.788580 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:00.808803 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:00.808778 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:01.579735 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:01.579708 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:09.007959 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:09.007923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:13.489639 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:13.489599 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:14.031451 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.031403 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:14.566468 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566434 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:59:14.566956 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566753 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="alertmanager" containerID="cri-o://ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9" gracePeriod=120 Jul 02 19:59:14.566956 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566787 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-metric" containerID="cri-o://81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032" gracePeriod=120 Jul 02 19:59:14.566956 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566832 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-web" containerID="cri-o://6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58" gracePeriod=120 Jul 02 19:59:14.566956 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566852 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="config-reloader" containerID="cri-o://b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b" gracePeriod=120 Jul 02 19:59:14.566956 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566904 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy" containerID="cri-o://2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39" gracePeriod=120 Jul 02 19:59:14.566956 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:14.566902 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="prom-label-proxy" containerID="cri-o://a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b" gracePeriod=120 Jul 02 19:59:15.623245 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623215 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b" exitCode=0 Jul 02 19:59:15.623245 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623239 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39" exitCode=0 Jul 02 19:59:15.623245 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623247 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b" exitCode=0 Jul 02 19:59:15.623724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623254 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9" exitCode=0 Jul 02 19:59:15.623724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623284 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b"} Jul 02 19:59:15.623724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623349 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39"} Jul 02 19:59:15.623724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623374 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b"} Jul 02 19:59:15.623724 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.623397 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9"} Jul 02 19:59:15.812627 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.812604 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:15.945976 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.945867 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-tls-assets\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.945976 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.945933 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-main-db\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.945976 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.945968 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946007 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-web-config\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946036 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-main-tls\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946062 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g85vb\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-kube-api-access-g85vb\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946090 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946114 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-volume\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946153 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-trusted-ca-bundle\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946198 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946271 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946249 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-metrics-client-ca\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946626 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946278 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-cluster-tls-config\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946626 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946318 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-out\") pod \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\" (UID: \"733b7c24-15bb-45e5-b8b1-65809bfd8b8f\") " Jul 02 19:59:15.946626 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.946580 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:15.947198 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.947166 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:15.947336 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.947314 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:15.949497 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.949436 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:15.949497 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.949436 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:15.949795 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.949754 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:15.949905 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.949826 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-kube-api-access-g85vb" (OuterVolumeSpecName: "kube-api-access-g85vb") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "kube-api-access-g85vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:15.949905 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.949853 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-volume" (OuterVolumeSpecName: "config-volume") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:15.950032 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.949911 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-out" (OuterVolumeSpecName: "config-out") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:15.950281 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.950252 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:15.950539 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.950516 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:15.954065 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.954046 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:15.963613 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:15.963584 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-web-config" (OuterVolumeSpecName: "web-config") pod "733b7c24-15bb-45e5-b8b1-65809bfd8b8f" (UID: "733b7c24-15bb-45e5-b8b1-65809bfd8b8f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:16.047661 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047632 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-main-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047661 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047664 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g85vb\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-kube-api-access-g85vb\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047680 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047695 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047711 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047726 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047740 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-metrics-client-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047755 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-cluster-tls-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047769 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-config-out\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047783 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-tls-assets\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047810 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-alertmanager-main-db\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047836 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.047868 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.047853 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/733b7c24-15bb-45e5-b8b1-65809bfd8b8f-web-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:16.630653 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630622 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032" exitCode=0 Jul 02 19:59:16.630653 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630648 2555 generic.go:356] "Generic (PLEG): container finished" podID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerID="6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58" exitCode=0 Jul 02 19:59:16.631049 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630707 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.631049 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630701 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032"} Jul 02 19:59:16.631049 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630859 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58"} Jul 02 19:59:16.631049 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630901 2555 scope.go:117] "RemoveContainer" containerID="a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b" Jul 02 19:59:16.631049 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.630909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"733b7c24-15bb-45e5-b8b1-65809bfd8b8f","Type":"ContainerDied","Data":"7c62081f26e32e919a2fffb2b35e1a9b3cd44c77425fe834f8866ca04fb9b277"} Jul 02 19:59:16.639476 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.639450 2555 scope.go:117] "RemoveContainer" containerID="81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032" Jul 02 19:59:16.646470 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.646450 2555 scope.go:117] "RemoveContainer" containerID="2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39" Jul 02 19:59:16.653008 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.652992 2555 scope.go:117] "RemoveContainer" containerID="6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58" Jul 02 19:59:16.657117 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.657096 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:59:16.660172 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.660152 2555 scope.go:117] "RemoveContainer" containerID="b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b" Jul 02 19:59:16.667331 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.667312 2555 scope.go:117] "RemoveContainer" containerID="ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9" Jul 02 19:59:16.668833 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.668814 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:59:16.674496 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.674480 2555 scope.go:117] "RemoveContainer" containerID="bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255" Jul 02 19:59:16.680946 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.680757 2555 scope.go:117] "RemoveContainer" containerID="a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b" Jul 02 19:59:16.681039 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.681018 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b\": container with ID starting with a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b not found: ID does not exist" containerID="a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b" Jul 02 19:59:16.681082 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681046 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b"} err="failed to get container status \"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b\": rpc error: code = NotFound desc = could not find container \"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b\": container with ID starting with a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b not found: ID does not exist" Jul 02 19:59:16.681082 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681063 2555 scope.go:117] "RemoveContainer" containerID="81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032" Jul 02 19:59:16.681250 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.681235 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032\": container with ID starting with 81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032 not found: ID does not exist" containerID="81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032" Jul 02 19:59:16.681288 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681257 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032"} err="failed to get container status \"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032\": rpc error: code = NotFound desc = could not find container \"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032\": container with ID starting with 81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032 not found: ID does not exist" Jul 02 19:59:16.681288 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681269 2555 scope.go:117] "RemoveContainer" containerID="2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39" Jul 02 19:59:16.681512 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.681494 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39\": container with ID starting with 2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39 not found: ID does not exist" containerID="2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39" Jul 02 19:59:16.681566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681517 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39"} err="failed to get container status \"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39\": rpc error: code = NotFound desc = could not find container \"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39\": container with ID starting with 2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39 not found: ID does not exist" Jul 02 19:59:16.681566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681533 2555 scope.go:117] "RemoveContainer" containerID="6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58" Jul 02 19:59:16.681696 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.681681 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58\": container with ID starting with 6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58 not found: ID does not exist" containerID="6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58" Jul 02 19:59:16.681744 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681698 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58"} err="failed to get container status \"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58\": rpc error: code = NotFound desc = could not find container \"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58\": container with ID starting with 6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58 not found: ID does not exist" Jul 02 19:59:16.681744 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681710 2555 scope.go:117] "RemoveContainer" containerID="b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b" Jul 02 19:59:16.681957 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.681941 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b\": container with ID starting with b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b not found: ID does not exist" containerID="b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b" Jul 02 19:59:16.682007 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681962 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b"} err="failed to get container status \"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b\": rpc error: code = NotFound desc = could not find container \"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b\": container with ID starting with b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b not found: ID does not exist" Jul 02 19:59:16.682007 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.681978 2555 scope.go:117] "RemoveContainer" containerID="ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9" Jul 02 19:59:16.682172 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.682157 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9\": container with ID starting with ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9 not found: ID does not exist" containerID="ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9" Jul 02 19:59:16.682217 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682177 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9"} err="failed to get container status \"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9\": rpc error: code = NotFound desc = could not find container \"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9\": container with ID starting with ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9 not found: ID does not exist" Jul 02 19:59:16.682217 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682197 2555 scope.go:117] "RemoveContainer" containerID="bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255" Jul 02 19:59:16.682405 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:16.682390 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255\": container with ID starting with bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255 not found: ID does not exist" containerID="bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255" Jul 02 19:59:16.682449 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682408 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255"} err="failed to get container status \"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255\": rpc error: code = NotFound desc = could not find container \"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255\": container with ID starting with bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255 not found: ID does not exist" Jul 02 19:59:16.682449 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682422 2555 scope.go:117] "RemoveContainer" containerID="a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b" Jul 02 19:59:16.682616 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682598 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b"} err="failed to get container status \"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b\": rpc error: code = NotFound desc = could not find container \"a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b\": container with ID starting with a74998527f25e392c44b90937ecb3dc1963875657e6a1887e97afecb5e245f1b not found: ID does not exist" Jul 02 19:59:16.682676 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682619 2555 scope.go:117] "RemoveContainer" containerID="81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032" Jul 02 19:59:16.682855 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682835 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032"} err="failed to get container status \"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032\": rpc error: code = NotFound desc = could not find container \"81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032\": container with ID starting with 81e14fa8d2d18ce2ea73ac241a4fb1038743ada773f2cc0b6a01557403965032 not found: ID does not exist" Jul 02 19:59:16.682933 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.682857 2555 scope.go:117] "RemoveContainer" containerID="2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39" Jul 02 19:59:16.683087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683070 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39"} err="failed to get container status \"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39\": rpc error: code = NotFound desc = could not find container \"2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39\": container with ID starting with 2b99ea581048753927a5f419f261908cb48bf175d7751349388209255f817d39 not found: ID does not exist" Jul 02 19:59:16.683131 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683087 2555 scope.go:117] "RemoveContainer" containerID="6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58" Jul 02 19:59:16.683313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683286 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58"} err="failed to get container status \"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58\": rpc error: code = NotFound desc = could not find container \"6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58\": container with ID starting with 6387902c177773596ba6901ff8ca37babede2c4dba5fa7bb216e3aed2e537d58 not found: ID does not exist" Jul 02 19:59:16.683381 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683314 2555 scope.go:117] "RemoveContainer" containerID="b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b" Jul 02 19:59:16.683536 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683521 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b"} err="failed to get container status \"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b\": rpc error: code = NotFound desc = could not find container \"b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b\": container with ID starting with b25902c70de517fdfb77af7a8a5e4a3d75059fee256ee11579f7c2e9e83bfe2b not found: ID does not exist" Jul 02 19:59:16.683587 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683536 2555 scope.go:117] "RemoveContainer" containerID="ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9" Jul 02 19:59:16.683742 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683724 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9"} err="failed to get container status \"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9\": rpc error: code = NotFound desc = could not find container \"ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9\": container with ID starting with ec3c4b843249892972e263adaa02baa354dbe6d5de2a42dc438b2abe383b6bf9 not found: ID does not exist" Jul 02 19:59:16.683786 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683743 2555 scope.go:117] "RemoveContainer" containerID="bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255" Jul 02 19:59:16.683955 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.683936 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255"} err="failed to get container status \"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255\": rpc error: code = NotFound desc = could not find container \"bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255\": container with ID starting with bc43b0d1b15a472434c538e9f626f0e2d612ae8b0fc3141d551bae8438453255 not found: ID does not exist" Jul 02 19:59:16.711519 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711497 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:59:16.711789 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711778 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="init-config-reloader" Jul 02 19:59:16.711789 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711790 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="init-config-reloader" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711804 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f23017-80ee-40d9-8cbf-8bd72a22d809" containerName="console" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711810 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f23017-80ee-40d9-8cbf-8bd72a22d809" containerName="console" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711823 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="alertmanager" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711829 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="alertmanager" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711835 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="config-reloader" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711841 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="config-reloader" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711848 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="prom-label-proxy" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711852 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="prom-label-proxy" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711859 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd1e11a-8ae6-4875-a46d-376abe841a2c" containerName="console" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711864 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd1e11a-8ae6-4875-a46d-376abe841a2c" containerName="console" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711869 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711887 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711894 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-metric" Jul 02 19:59:16.711897 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711899 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-metric" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711907 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-web" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711913 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-web" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711957 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f23017-80ee-40d9-8cbf-8bd72a22d809" containerName="console" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711965 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd1e11a-8ae6-4875-a46d-376abe841a2c" containerName="console" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711971 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="config-reloader" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711977 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-metric" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711983 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711989 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="prom-label-proxy" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711994 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="alertmanager" Jul 02 19:59:16.712328 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.711999 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" containerName="kube-rbac-proxy-web" Jul 02 19:59:16.715657 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.715639 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.718814 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.718788 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 19:59:16.718948 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.718932 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 19:59:16.719334 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.719318 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 19:59:16.719436 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.719422 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 19:59:16.719722 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.719706 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5qxp7\"" Jul 02 19:59:16.720165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.720129 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 19:59:16.720165 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.720130 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 19:59:16.720327 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.720309 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 19:59:16.720944 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.720929 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 19:59:16.727111 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.727095 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 19:59:16.742310 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.742277 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:59:16.855463 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-config-out\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855463 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47dh\" (UniqueName: \"kubernetes.io/projected/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-kube-api-access-t47dh\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-web-config\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855619 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855732 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855629 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855732 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855667 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855732 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855693 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855732 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855710 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855919 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855761 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855919 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855919 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.855919 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.855848 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957199 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957199 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957199 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957219 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957243 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-config-out\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47dh\" (UniqueName: \"kubernetes.io/projected/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-kube-api-access-t47dh\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957407 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957461 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957439 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-web-config\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957703 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957482 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957703 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957535 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957703 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957703 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957639 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.957703 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.957670 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.958855 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.958808 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.959010 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.958950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.959240 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.959196 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.960171 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.960146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.960459 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.960435 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-config-out\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.960601 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.960563 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.960705 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.960683 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.960750 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.960708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.961070 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.961052 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.961167 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.961131 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.961587 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.961568 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.962171 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.962151 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-web-config\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:16.966326 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:16.966306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47dh\" (UniqueName: \"kubernetes.io/projected/29caf4af-19e8-4eb1-824c-00ad75c8c8c8-kube-api-access-t47dh\") pod \"alertmanager-main-0\" (UID: \"29caf4af-19e8-4eb1-824c-00ad75c8c8c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:17.025341 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:17.025318 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 19:59:17.173836 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:17.173811 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 19:59:17.175101 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:59:17.175077 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29caf4af_19e8_4eb1_824c_00ad75c8c8c8.slice/crio-b94f977c35d31b22bc25ff5cfa4870a9ab72016724b8d1d5a6ce2f559971f16e WatchSource:0}: Error finding container b94f977c35d31b22bc25ff5cfa4870a9ab72016724b8d1d5a6ce2f559971f16e: Status 404 returned error can't find the container with id b94f977c35d31b22bc25ff5cfa4870a9ab72016724b8d1d5a6ce2f559971f16e Jul 02 19:59:17.636505 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:17.636473 2555 generic.go:356] "Generic (PLEG): container finished" podID="29caf4af-19e8-4eb1-824c-00ad75c8c8c8" containerID="16b8a4ff8602be1b9cb865fe83390acb8cadfee92a59b3d1396115616e8bd347" exitCode=0 Jul 02 19:59:17.636952 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:17.636562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerDied","Data":"16b8a4ff8602be1b9cb865fe83390acb8cadfee92a59b3d1396115616e8bd347"} Jul 02 19:59:17.636952 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:17.636650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"b94f977c35d31b22bc25ff5cfa4870a9ab72016724b8d1d5a6ce2f559971f16e"} Jul 02 19:59:17.873190 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:17.873164 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733b7c24-15bb-45e5-b8b1-65809bfd8b8f" path="/var/lib/kubelet/pods/733b7c24-15bb-45e5-b8b1-65809bfd8b8f/volumes" Jul 02 19:59:18.625968 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.625931 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55fcd48884-8r477"] Jul 02 19:59:18.628596 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.628564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.631469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.631448 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 19:59:18.632215 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.632197 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 19:59:18.632305 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.632229 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 19:59:18.632624 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.632607 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 19:59:18.632745 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.632694 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 19:59:18.632920 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.632905 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w7rzf\"" Jul 02 19:59:18.639863 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.639844 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 19:59:18.645469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.645444 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"3ff2ef5206083c3e9a61c6f7ea3b0013a81b18628dd7c1f3a0b43bd8d37845bc"} Jul 02 19:59:18.645575 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.645504 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"3d284223648387648779b03fbc5f6eac9428ae4bf61cc3271b7cf6eaec3fbb4f"} Jul 02 19:59:18.645575 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.645531 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"f69c96af7260e137e5e235d297a2dbec93733b3906d6caa67429aad80382bf87"} Jul 02 19:59:18.645575 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.645559 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"7741217ddc57eed966ff802cb9ae824765f3a0bf6b9caff6b86dcf124bfb5bb9"} Jul 02 19:59:18.645732 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.645584 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"2bb22c4fefe77998022bd47f299c7a0df59bbbfd5445390b82351cee1e3f5cbd"} Jul 02 19:59:18.645732 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.645607 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"29caf4af-19e8-4eb1-824c-00ad75c8c8c8","Type":"ContainerStarted","Data":"c7b947b03615c64e932853d1fb13816bc103fd91db1dc48f349a884d1b57247f"} Jul 02 19:59:18.714660 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.714448 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55fcd48884-8r477"] Jul 02 19:59:18.716550 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.716507 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.695423488 podStartE2EDuration="2.716490221s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.066733ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:18.714132441 +0000 UTC m=+153.444574848" watchObservedRunningTime="2026-07-02 19:59:18.716490221 +0000 UTC m=+153.446932630" Jul 02 19:59:18.772172 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772131 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.772346 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772180 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-secret-telemeter-client\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.772547 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.772671 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-federate-client-tls\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.772733 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-metrics-client-ca\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.772798 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-telemeter-client-tls\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.772850 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772830 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnhdx\" (UniqueName: \"kubernetes.io/projected/8cffb28b-64e8-463e-bf3f-9488aa4d236d-kube-api-access-dnhdx\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.773000 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.772984 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-serving-certs-ca-bundle\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.873613 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873571 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.873770 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-federate-client-tls\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.873770 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-metrics-client-ca\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.873770 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-telemeter-client-tls\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.873896 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnhdx\" (UniqueName: \"kubernetes.io/projected/8cffb28b-64e8-463e-bf3f-9488aa4d236d-kube-api-access-dnhdx\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.873896 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-serving-certs-ca-bundle\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.874056 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873913 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.874056 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.873941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-secret-telemeter-client\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.874624 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.874592 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-metrics-client-ca\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.874740 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.874646 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-serving-certs-ca-bundle\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.875136 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.875111 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cffb28b-64e8-463e-bf3f-9488aa4d236d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.877784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.876953 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-telemeter-client-tls\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.877784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.877329 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.877784 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.877702 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-secret-telemeter-client\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.878850 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.878829 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8cffb28b-64e8-463e-bf3f-9488aa4d236d-federate-client-tls\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.886373 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.886347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnhdx\" (UniqueName: \"kubernetes.io/projected/8cffb28b-64e8-463e-bf3f-9488aa4d236d-kube-api-access-dnhdx\") pod \"telemeter-client-55fcd48884-8r477\" (UID: \"8cffb28b-64e8-463e-bf3f-9488aa4d236d\") " pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:18.940333 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:18.940314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" Jul 02 19:59:19.060482 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.060448 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:59:19.060846 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.060819 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="prometheus" containerID="cri-o://455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d" gracePeriod=600 Jul 02 19:59:19.060924 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.060886 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-web" containerID="cri-o://ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e" gracePeriod=600 Jul 02 19:59:19.060982 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.060917 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="config-reloader" containerID="cri-o://9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801" gracePeriod=600 Jul 02 19:59:19.060982 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.060949 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy" containerID="cri-o://b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00" gracePeriod=600 Jul 02 19:59:19.061087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.060917 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="thanos-sidecar" containerID="cri-o://389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113" gracePeriod=600 Jul 02 19:59:19.061087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.061022 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9" gracePeriod=600 Jul 02 19:59:19.145836 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.145760 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55fcd48884-8r477"] Jul 02 19:59:19.148438 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:59:19.148415 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cffb28b_64e8_463e_bf3f_9488aa4d236d.slice/crio-d8196aea9e55a91a541b98d8657fa04cd0ad3df77ad7f089ec533aaf56a098ab WatchSource:0}: Error finding container d8196aea9e55a91a541b98d8657fa04cd0ad3df77ad7f089ec533aaf56a098ab: Status 404 returned error can't find the container with id d8196aea9e55a91a541b98d8657fa04cd0ad3df77ad7f089ec533aaf56a098ab Jul 02 19:59:19.654048 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654020 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9" exitCode=0 Jul 02 19:59:19.654048 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654046 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00" exitCode=0 Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654055 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113" exitCode=0 Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654064 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801" exitCode=0 Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654072 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d" exitCode=0 Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654090 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9"} Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654166 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00"} Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654207 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113"} Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801"} Jul 02 19:59:19.654427 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.654272 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d"} Jul 02 19:59:19.655157 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:19.655132 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" event={"ID":"8cffb28b-64e8-463e-bf3f-9488aa4d236d","Type":"ContainerStarted","Data":"d8196aea9e55a91a541b98d8657fa04cd0ad3df77ad7f089ec533aaf56a098ab"} Jul 02 19:59:20.326053 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.326030 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.489368 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489289 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-config\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489368 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489339 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-kube-rbac-proxy\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489376 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-config-out\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489397 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-db\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489429 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-trusted-ca-bundle\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489481 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-0\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489514 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-1\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489543 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-thanos-prometheus-http-client-file\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489570 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-metrics-client-ca\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.489603 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489596 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-kubelet-serving-ca-bundle\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.490025 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489613 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-grpc-tls\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.490025 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489639 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.490025 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489676 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-serving-certs-ca-bundle\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.490025 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489702 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-2\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.490025 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.489727 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-tls\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.490272 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490010 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.490439 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490413 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490553 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490607 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkvph\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-kube-api-access-wkvph\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490644 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-tls-assets\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490675 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490702 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-metrics-client-certs\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.490777 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-web-config\") pod \"85784e60-9a7a-4435-bc52-8e9588fd1425\" (UID: \"85784e60-9a7a-4435-bc52-8e9588fd1425\") " Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.491212 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.491233 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-metrics-client-ca\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.491477 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.491247 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.492983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.492084 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.492983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.492187 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.492983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.492513 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.492983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.492578 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.492983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.492761 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:20.492983 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.492951 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:20.494378 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.494318 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-config" (OuterVolumeSpecName: "config") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.494467 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.494435 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.494637 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.494593 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.494637 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.494607 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.495105 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.495080 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.495658 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.495630 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:20.495982 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.495942 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-config-out" (OuterVolumeSpecName: "config-out") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:20.496259 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.496234 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-kube-api-access-wkvph" (OuterVolumeSpecName: "kube-api-access-wkvph") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "kube-api-access-wkvph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:20.496368 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.496265 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.496679 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.496656 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.508351 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.508329 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-web-config" (OuterVolumeSpecName: "web-config") pod "85784e60-9a7a-4435-bc52-8e9588fd1425" (UID: "85784e60-9a7a-4435-bc52-8e9588fd1425"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:20.591804 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591773 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.591804 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591803 2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591819 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591831 2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-grpc-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591843 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591857 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591869 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591904 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591917 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkvph\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-kube-api-access-wkvph\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591929 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85784e60-9a7a-4435-bc52-8e9588fd1425-tls-assets\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591940 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591970 2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-metrics-client-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591983 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-web-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.591994 2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-config\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.592006 2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85784e60-9a7a-4435-bc52-8e9588fd1425-secret-kube-rbac-proxy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.592017 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-config-out\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.592095 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.592029 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/85784e60-9a7a-4435-bc52-8e9588fd1425-prometheus-k8s-db\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.664570 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.664537 2555 generic.go:356] "Generic (PLEG): container finished" podID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerID="ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e" exitCode=0 Jul 02 19:59:20.665021 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.664630 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.665021 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.664626 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e"} Jul 02 19:59:20.665021 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.664749 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"85784e60-9a7a-4435-bc52-8e9588fd1425","Type":"ContainerDied","Data":"941992ed7bf099c167880984efcc0748801cc5f253edb85c309aa0a811bd4c20"} Jul 02 19:59:20.665021 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.664787 2555 scope.go:117] "RemoveContainer" containerID="b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9" Jul 02 19:59:20.691783 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.691756 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:59:20.701042 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.701017 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:59:20.734976 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.734947 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:59:20.735325 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735307 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="init-config-reloader" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735329 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="init-config-reloader" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735343 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="thanos-sidecar" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735351 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="thanos-sidecar" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735364 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="config-reloader" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735370 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="config-reloader" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735377 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735382 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735397 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="prometheus" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735402 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="prometheus" Jul 02 19:59:20.735407 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735408 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-web" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735413 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-web" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735423 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-thanos" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735431 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-thanos" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735496 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-thanos" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735506 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="prometheus" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735514 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735525 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="thanos-sidecar" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735533 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="kube-rbac-proxy-web" Jul 02 19:59:20.735756 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.735539 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" containerName="config-reloader" Jul 02 19:59:20.738922 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.738900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.742483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742246 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 19:59:20.742483 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742387 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 19:59:20.742627 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742487 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bqa6sqkqqs5og\"" Jul 02 19:59:20.742627 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742522 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k2fpx\"" Jul 02 19:59:20.742627 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742607 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 19:59:20.742771 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742650 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 19:59:20.742771 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.742718 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 19:59:20.743038 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743018 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 19:59:20.743110 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743072 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 19:59:20.743164 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743107 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 19:59:20.743164 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743126 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 19:59:20.743164 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743138 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 19:59:20.743313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743288 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 19:59:20.743369 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.743329 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 19:59:20.747906 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.747851 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 19:59:20.751740 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.751575 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 19:59:20.774482 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.772373 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:59:20.893898 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.893843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894058 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.893910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5cx5\" (UniqueName: \"kubernetes.io/projected/8f4c909a-0345-4009-a0dc-0c8644efacc1-kube-api-access-g5cx5\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894058 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.893938 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894058 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.893963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894096 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f4c909a-0345-4009-a0dc-0c8644efacc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894252 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894247 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894370 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894402 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894469 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894631 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894631 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-config\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894631 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f4c909a-0345-4009-a0dc-0c8644efacc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894631 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.894631 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.894592 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.995766 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.995766 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995734 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-config\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.995766 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995763 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f4c909a-0345-4009-a0dc-0c8644efacc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995852 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5cx5\" (UniqueName: \"kubernetes.io/projected/8f4c909a-0345-4009-a0dc-0c8644efacc1-kube-api-access-g5cx5\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.995953 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f4c909a-0345-4009-a0dc-0c8644efacc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996087 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996084 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996173 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996199 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996302 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996499 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996900 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996540 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996900 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996649 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.996900 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.996661 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.997415 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.997132 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.997415 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.997204 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.999428 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.999121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f4c909a-0345-4009-a0dc-0c8644efacc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:20.999523 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.999424 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:20.999828 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.000352 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f4c909a-0345-4009-a0dc-0c8644efacc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.000498 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.001208 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.001439 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.001460 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.001704 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.001926 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.001855 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.002978 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.002946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.002978 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.002967 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-config\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.003566 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.003543 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f4c909a-0345-4009-a0dc-0c8644efacc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.003729 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.003708 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f4c909a-0345-4009-a0dc-0c8644efacc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.011849 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.011830 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5cx5\" (UniqueName: \"kubernetes.io/projected/8f4c909a-0345-4009-a0dc-0c8644efacc1-kube-api-access-g5cx5\") pod \"prometheus-k8s-0\" (UID: \"8f4c909a-0345-4009-a0dc-0c8644efacc1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.052691 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.052659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:21.089379 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.089355 2555 scope.go:117] "RemoveContainer" containerID="b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00" Jul 02 19:59:21.114543 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.114507 2555 scope.go:117] "RemoveContainer" containerID="ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e" Jul 02 19:59:21.122173 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.122148 2555 scope.go:117] "RemoveContainer" containerID="389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113" Jul 02 19:59:21.134306 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.134223 2555 scope.go:117] "RemoveContainer" containerID="9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801" Jul 02 19:59:21.149663 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.148013 2555 scope.go:117] "RemoveContainer" containerID="455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d" Jul 02 19:59:21.156612 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.156587 2555 scope.go:117] "RemoveContainer" containerID="cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef" Jul 02 19:59:21.168620 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.168597 2555 scope.go:117] "RemoveContainer" containerID="b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9" Jul 02 19:59:21.168948 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.168927 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9\": container with ID starting with b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9 not found: ID does not exist" containerID="b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9" Jul 02 19:59:21.169030 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.168959 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9"} err="failed to get container status \"b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9\": rpc error: code = NotFound desc = could not find container \"b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9\": container with ID starting with b460969fcd972866b92f8896270e969d5b6f6919c8ab19b4f52f33a5b21b9ff9 not found: ID does not exist" Jul 02 19:59:21.169030 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.168978 2555 scope.go:117] "RemoveContainer" containerID="b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00" Jul 02 19:59:21.169302 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.169284 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00\": container with ID starting with b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00 not found: ID does not exist" containerID="b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00" Jul 02 19:59:21.169338 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.169308 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00"} err="failed to get container status \"b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00\": rpc error: code = NotFound desc = could not find container \"b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00\": container with ID starting with b200e8a5e79ffd423a418df2707ef2c9c24abbf181aa0fde621798629a6cbf00 not found: ID does not exist" Jul 02 19:59:21.169338 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.169322 2555 scope.go:117] "RemoveContainer" containerID="ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e" Jul 02 19:59:21.169601 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.169580 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e\": container with ID starting with ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e not found: ID does not exist" containerID="ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e" Jul 02 19:59:21.169652 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.169609 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e"} err="failed to get container status \"ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e\": rpc error: code = NotFound desc = could not find container \"ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e\": container with ID starting with ed633180f452eccc359c331252b145da6bbd747a13d0bf7e2a6c3ea6f7bf120e not found: ID does not exist" Jul 02 19:59:21.169652 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.169631 2555 scope.go:117] "RemoveContainer" containerID="389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113" Jul 02 19:59:21.169954 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.169934 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113\": container with ID starting with 389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113 not found: ID does not exist" containerID="389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113" Jul 02 19:59:21.170006 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.169961 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113"} err="failed to get container status \"389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113\": rpc error: code = NotFound desc = could not find container \"389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113\": container with ID starting with 389e7d07f75027ba1ad2c7aeed192d0e33c8a5eff34344c8dd6a4f9c8e248113 not found: ID does not exist" Jul 02 19:59:21.170006 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.169980 2555 scope.go:117] "RemoveContainer" containerID="9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801" Jul 02 19:59:21.170260 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.170237 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801\": container with ID starting with 9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801 not found: ID does not exist" containerID="9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801" Jul 02 19:59:21.170314 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.170268 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801"} err="failed to get container status \"9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801\": rpc error: code = NotFound desc = could not find container \"9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801\": container with ID starting with 9d64edb50d1423e59c4165fbe454e8089b691618942202e5d4a9282dbae41801 not found: ID does not exist" Jul 02 19:59:21.170314 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.170292 2555 scope.go:117] "RemoveContainer" containerID="455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d" Jul 02 19:59:21.170541 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.170522 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d\": container with ID starting with 455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d not found: ID does not exist" containerID="455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d" Jul 02 19:59:21.170584 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.170547 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d"} err="failed to get container status \"455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d\": rpc error: code = NotFound desc = could not find container \"455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d\": container with ID starting with 455ed2acdd4c7e39fe4699d5eca4ad10890de63e64d43645b65a75a9cef69c5d not found: ID does not exist" Jul 02 19:59:21.170584 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.170571 2555 scope.go:117] "RemoveContainer" containerID="cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef" Jul 02 19:59:21.170836 ip-10-0-136-8 kubenswrapper[2555]: E0702 19:59:21.170815 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef\": container with ID starting with cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef not found: ID does not exist" containerID="cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef" Jul 02 19:59:21.170917 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.170843 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef"} err="failed to get container status \"cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef\": rpc error: code = NotFound desc = could not find container \"cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef\": container with ID starting with cf76a93b781f968a6b6dc65d7ca8a273711b691a82ee7a88c6d2e63cbc7ca3ef not found: ID does not exist" Jul 02 19:59:21.234282 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.234238 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 19:59:21.236943 ip-10-0-136-8 kubenswrapper[2555]: W0702 19:59:21.236917 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4c909a_0345_4009_a0dc_0c8644efacc1.slice/crio-63d4922591c89ce4ceb721720e934a0cc14ac124752094df3b6d1da8b32c375c WatchSource:0}: Error finding container 63d4922591c89ce4ceb721720e934a0cc14ac124752094df3b6d1da8b32c375c: Status 404 returned error can't find the container with id 63d4922591c89ce4ceb721720e934a0cc14ac124752094df3b6d1da8b32c375c Jul 02 19:59:21.671386 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.671298 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" event={"ID":"8cffb28b-64e8-463e-bf3f-9488aa4d236d","Type":"ContainerStarted","Data":"9c6242d7436bbaa25ce46c8fdc0e01aafe48beefe0d7c5b60513e1a22c26d728"} Jul 02 19:59:21.671386 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.671365 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" event={"ID":"8cffb28b-64e8-463e-bf3f-9488aa4d236d","Type":"ContainerStarted","Data":"ec7df0738828f771474629a810c157f0f6c5b4a4ee5e0aa5873fd173593c1c8f"} Jul 02 19:59:21.671913 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.671395 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" event={"ID":"8cffb28b-64e8-463e-bf3f-9488aa4d236d","Type":"ContainerStarted","Data":"63688022ced133820c49771512a349ef94d01d85f175833905d65054331c7c8e"} Jul 02 19:59:21.672718 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.672694 2555 generic.go:356] "Generic (PLEG): container finished" podID="8f4c909a-0345-4009-a0dc-0c8644efacc1" containerID="c1b34dcd2928fe351899389ba008b00f37664239e22c0731c0b3461706129943" exitCode=0 Jul 02 19:59:21.672820 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.672730 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerDied","Data":"c1b34dcd2928fe351899389ba008b00f37664239e22c0731c0b3461706129943"} Jul 02 19:59:21.672820 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.672786 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"63d4922591c89ce4ceb721720e934a0cc14ac124752094df3b6d1da8b32c375c"} Jul 02 19:59:21.700123 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.700077 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55fcd48884-8r477" podStartSLOduration=1.744631388 podStartE2EDuration="3.700061755s" totalImagesPullingTime="1.955430367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:21.69805974 +0000 UTC m=+156.428502147" watchObservedRunningTime="2026-07-02 19:59:21.700061755 +0000 UTC m=+156.430504160" Jul 02 19:59:21.880313 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:21.879965 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85784e60-9a7a-4435-bc52-8e9588fd1425" path="/var/lib/kubelet/pods/85784e60-9a7a-4435-bc52-8e9588fd1425/volumes" Jul 02 19:59:22.451238 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.451207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:22.521497 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.521455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:22.682934 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.682896 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"df00d71e9332914efa7a3fc58d0a1b847737b9e5f4f03123c98d0c801404784f"} Jul 02 19:59:22.683321 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.682966 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"45e3611bdfd49c94be89698386d1b00c64583c3e5ad19e4de150d5d30d65c47e"} Jul 02 19:59:22.683321 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.682996 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"6b1e0f67a157e78d4e3cdda2cc149ed0b9112796bfa03c03aa939a710058042a"} Jul 02 19:59:22.683321 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.683020 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"4306ae225fd872c4de993365add36d47264bbb656b5a7c29b7bae7169632a54a"} Jul 02 19:59:22.683321 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.683043 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"b1dc322e75d78d8c0a2d272c16a12b7ae24f206e4b3f69f0a49ac7f0f18ce4fb"} Jul 02 19:59:22.683321 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.683067 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f4c909a-0345-4009-a0dc-0c8644efacc1","Type":"ContainerStarted","Data":"c30317a0884b281fb6e113420e642047f0d0d8ad214d5add953b33698a80cff1"} Jul 02 19:59:22.723382 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:22.723271 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.700683799 podStartE2EDuration="2.723252153s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.568354ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:22.720824467 +0000 UTC m=+157.451266899" watchObservedRunningTime="2026-07-02 19:59:22.723252153 +0000 UTC m=+157.453694560" Jul 02 19:59:26.053482 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:26.053448 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 19:59:33.781985 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:33.781948 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:33.882478 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:33.882441 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 19:59:33.950523 ip-10-0-136-8 kubenswrapper[2555]: I0702 19:59:33.950479 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:15.225329 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:15.225297 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:15.325083 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:15.325048 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:21.053669 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:21.053623 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:00:21.068733 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:21.068709 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:00:21.943844 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:21.943816 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:00:28.796434 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:28.796396 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:29.079330 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:29.079222 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:30.719682 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:30.719651 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.107116 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:31.107085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.434978 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:31.434896 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.645413 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:31.645360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:31.998459 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:31.998411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:40.771755 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:40.771720 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:40.846618 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:40.846580 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:42.162030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:42.161989 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:42.265530 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:42.265496 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:42.334365 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:42.334318 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:48.441400 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:48.441340 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:00:48.509039 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:00:48.508986 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:16.800927 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:16.800812 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:16.975081 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:16.975048 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:30.023358 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:30.023320 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:44.061705 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:44.061667 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:44.859430 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:44.859394 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:45.725299 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:45.725269 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:01:45.727741 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:45.727717 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:01:45.728829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:45.728807 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 20:01:47.671233 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:47.671196 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:47.772059 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:47.772027 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:48.749951 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:48.749904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:48.930987 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:48.930952 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:49.882345 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:49.882313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:50.008063 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:50.008029 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:52.132105 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.132070 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:52.523089 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.523045 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:52.533646 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.533604 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg"] Jul 02 20:01:52.536917 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.536896 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.539573 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.539552 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hgvl7\"" Jul 02 20:01:52.539775 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.539761 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 20:01:52.540532 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.540516 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 20:01:52.550019 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.549999 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg"] Jul 02 20:01:52.576560 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.576525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/208791c7-8392-48ef-8f79-3b9565551a91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sf2lg\" (UID: \"208791c7-8392-48ef-8f79-3b9565551a91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.576560 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.576565 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffx7\" (UniqueName: \"kubernetes.io/projected/208791c7-8392-48ef-8f79-3b9565551a91-kube-api-access-hffx7\") pod \"cert-manager-cainjector-559cdd8c87-sf2lg\" (UID: \"208791c7-8392-48ef-8f79-3b9565551a91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.677807 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.677776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/208791c7-8392-48ef-8f79-3b9565551a91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sf2lg\" (UID: \"208791c7-8392-48ef-8f79-3b9565551a91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.677986 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.677815 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hffx7\" (UniqueName: \"kubernetes.io/projected/208791c7-8392-48ef-8f79-3b9565551a91-kube-api-access-hffx7\") pod \"cert-manager-cainjector-559cdd8c87-sf2lg\" (UID: \"208791c7-8392-48ef-8f79-3b9565551a91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.686693 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.686662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/208791c7-8392-48ef-8f79-3b9565551a91-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sf2lg\" (UID: \"208791c7-8392-48ef-8f79-3b9565551a91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.686822 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.686721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffx7\" (UniqueName: \"kubernetes.io/projected/208791c7-8392-48ef-8f79-3b9565551a91-kube-api-access-hffx7\") pod \"cert-manager-cainjector-559cdd8c87-sf2lg\" (UID: \"208791c7-8392-48ef-8f79-3b9565551a91\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.856560 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.856475 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" Jul 02 20:01:52.983031 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.983005 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg"] Jul 02 20:01:52.985616 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:01:52.985588 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod208791c7_8392_48ef_8f79_3b9565551a91.slice/crio-0d9c1a23227711c5feed3644c7d9485fccf5e9c79320c880294fe384ee4f45b0 WatchSource:0}: Error finding container 0d9c1a23227711c5feed3644c7d9485fccf5e9c79320c880294fe384ee4f45b0: Status 404 returned error can't find the container with id 0d9c1a23227711c5feed3644c7d9485fccf5e9c79320c880294fe384ee4f45b0 Jul 02 20:01:52.987906 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:52.987888 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:01:53.283640 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:53.283609 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" event={"ID":"208791c7-8392-48ef-8f79-3b9565551a91","Type":"ContainerStarted","Data":"0d9c1a23227711c5feed3644c7d9485fccf5e9c79320c880294fe384ee4f45b0"} Jul 02 20:01:54.256323 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:54.256241 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:54.364553 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:54.364513 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:57.197827 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:57.197791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:57.288024 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:57.287985 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:01:57.304509 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:57.304478 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" event={"ID":"208791c7-8392-48ef-8f79-3b9565551a91","Type":"ContainerStarted","Data":"22b2b1682956797f96f4922c5de3c251c8b106fcec169483a443bacac5789714"} Jul 02 20:01:57.322697 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:57.322648 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sf2lg" podStartSLOduration=1.894670396 podStartE2EDuration="5.322633325s" totalImagesPullingTime="3.427962929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:01:57.321245765 +0000 UTC m=+312.051688171" watchObservedRunningTime="2026-07-02 20:01:57.322633325 +0000 UTC m=+312.053075731" Jul 02 20:01:59.750113 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:01:59.750080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:00.647191 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.647148 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4df9z"] Jul 02 20:02:00.653118 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.653089 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.656805 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.656782 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kw2nj\"" Jul 02 20:02:00.661755 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.661730 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4df9z"] Jul 02 20:02:00.746522 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.746493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/975b1eed-b6bc-483c-8398-aa1a0f430019-bound-sa-token\") pod \"cert-manager-55b4d954d5-4df9z\" (UID: \"975b1eed-b6bc-483c-8398-aa1a0f430019\") " pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.746704 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.746544 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdsm\" (UniqueName: \"kubernetes.io/projected/975b1eed-b6bc-483c-8398-aa1a0f430019-kube-api-access-5wdsm\") pod \"cert-manager-55b4d954d5-4df9z\" (UID: \"975b1eed-b6bc-483c-8398-aa1a0f430019\") " pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.847354 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.847306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/975b1eed-b6bc-483c-8398-aa1a0f430019-bound-sa-token\") pod \"cert-manager-55b4d954d5-4df9z\" (UID: \"975b1eed-b6bc-483c-8398-aa1a0f430019\") " pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.847737 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.847382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdsm\" (UniqueName: \"kubernetes.io/projected/975b1eed-b6bc-483c-8398-aa1a0f430019-kube-api-access-5wdsm\") pod \"cert-manager-55b4d954d5-4df9z\" (UID: \"975b1eed-b6bc-483c-8398-aa1a0f430019\") " pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.858527 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.858494 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdsm\" (UniqueName: \"kubernetes.io/projected/975b1eed-b6bc-483c-8398-aa1a0f430019-kube-api-access-5wdsm\") pod \"cert-manager-55b4d954d5-4df9z\" (UID: \"975b1eed-b6bc-483c-8398-aa1a0f430019\") " pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.858670 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.858647 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/975b1eed-b6bc-483c-8398-aa1a0f430019-bound-sa-token\") pod \"cert-manager-55b4d954d5-4df9z\" (UID: \"975b1eed-b6bc-483c-8398-aa1a0f430019\") " pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:00.962996 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:00.962902 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4df9z" Jul 02 20:02:01.094668 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:01.094629 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4df9z"] Jul 02 20:02:01.097858 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:02:01.097828 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod975b1eed_b6bc_483c_8398_aa1a0f430019.slice/crio-861fdea789448e6d477e181661c23e757d625a8f41ce2dfe6045da8886feff7a WatchSource:0}: Error finding container 861fdea789448e6d477e181661c23e757d625a8f41ce2dfe6045da8886feff7a: Status 404 returned error can't find the container with id 861fdea789448e6d477e181661c23e757d625a8f41ce2dfe6045da8886feff7a Jul 02 20:02:01.322298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:01.322258 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4df9z" event={"ID":"975b1eed-b6bc-483c-8398-aa1a0f430019","Type":"ContainerStarted","Data":"85d110032d752a871ff2b87a7668f82c8dd0c3c47df269586ecf5d1f0e781d22"} Jul 02 20:02:01.322298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:01.322307 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4df9z" event={"ID":"975b1eed-b6bc-483c-8398-aa1a0f430019","Type":"ContainerStarted","Data":"861fdea789448e6d477e181661c23e757d625a8f41ce2dfe6045da8886feff7a"} Jul 02 20:02:01.340107 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:01.340056 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4df9z" podStartSLOduration=1.340041242 podStartE2EDuration="1.340041242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:01.33946466 +0000 UTC m=+316.069907075" watchObservedRunningTime="2026-07-02 20:02:01.340041242 +0000 UTC m=+316.070483648" Jul 02 20:02:02.417035 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:02.416995 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:02.512010 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:02.511979 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:08.005520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:08.005485 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:08.104989 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:08.104948 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:10.289514 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:10.289479 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:22.695353 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.695314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:22.730106 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.730072 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8"] Jul 02 20:02:22.733368 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.733348 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.736275 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.736255 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 20:02:22.736381 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.736257 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 20:02:22.737233 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.737213 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 20:02:22.737350 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.737290 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 20:02:22.737350 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.737332 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:02:22.737472 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.737453 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gmdlx\"" Jul 02 20:02:22.750428 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.750404 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8"] Jul 02 20:02:22.786558 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.786515 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:22.840727 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.840691 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39574b68-e87b-4284-a24a-50415b00e49b-metrics-cert\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.840931 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.840738 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39574b68-e87b-4284-a24a-50415b00e49b-manager-config\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.840931 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.840831 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn7z4\" (UniqueName: \"kubernetes.io/projected/39574b68-e87b-4284-a24a-50415b00e49b-kube-api-access-vn7z4\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.840931 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.840864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39574b68-e87b-4284-a24a-50415b00e49b-cert\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.942137 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.942089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn7z4\" (UniqueName: \"kubernetes.io/projected/39574b68-e87b-4284-a24a-50415b00e49b-kube-api-access-vn7z4\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.942137 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.942135 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39574b68-e87b-4284-a24a-50415b00e49b-cert\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.942415 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.942179 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39574b68-e87b-4284-a24a-50415b00e49b-metrics-cert\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.942415 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.942201 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39574b68-e87b-4284-a24a-50415b00e49b-manager-config\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.942988 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.942964 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/39574b68-e87b-4284-a24a-50415b00e49b-manager-config\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.944585 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.944555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/39574b68-e87b-4284-a24a-50415b00e49b-metrics-cert\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.944676 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.944656 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39574b68-e87b-4284-a24a-50415b00e49b-cert\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:22.952341 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:22.952286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn7z4\" (UniqueName: \"kubernetes.io/projected/39574b68-e87b-4284-a24a-50415b00e49b-kube-api-access-vn7z4\") pod \"lws-controller-manager-58965cb8bc-gxxs8\" (UID: \"39574b68-e87b-4284-a24a-50415b00e49b\") " pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:23.043538 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:23.043489 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:23.191250 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:23.191218 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8"] Jul 02 20:02:23.194398 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:02:23.194367 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39574b68_e87b_4284_a24a_50415b00e49b.slice/crio-454e1a3d43cdf5d5e4ebe2414c70a180e391afc44b93f1268ec7baf41afedc35 WatchSource:0}: Error finding container 454e1a3d43cdf5d5e4ebe2414c70a180e391afc44b93f1268ec7baf41afedc35: Status 404 returned error can't find the container with id 454e1a3d43cdf5d5e4ebe2414c70a180e391afc44b93f1268ec7baf41afedc35 Jul 02 20:02:23.416256 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:23.416220 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" event={"ID":"39574b68-e87b-4284-a24a-50415b00e49b","Type":"ContainerStarted","Data":"454e1a3d43cdf5d5e4ebe2414c70a180e391afc44b93f1268ec7baf41afedc35"} Jul 02 20:02:24.514181 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:24.514122 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:24.631570 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:24.631533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:24.920569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:24.920477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.152559 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.152517 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.252181 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.252118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.320261 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.320233 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx"] Jul 02 20:02:25.324255 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.324210 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.329116 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.329060 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 20:02:25.329333 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.329301 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 20:02:25.329561 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.329539 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mh7lb\"" Jul 02 20:02:25.329561 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.329539 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 20:02:25.329727 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.329703 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 20:02:25.346670 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.346641 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx"] Jul 02 20:02:25.467604 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.467564 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.467604 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.467619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnrh\" (UniqueName: \"kubernetes.io/projected/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-kube-api-access-7qnrh\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.467902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.467649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.467902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.467701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-manifests\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.467902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.467736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-tmp\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.530225 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.530152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.568253 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.568217 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-manifests\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.568405 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.568271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-tmp\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.568405 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.568317 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.568405 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.568362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnrh\" (UniqueName: \"kubernetes.io/projected/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-kube-api-access-7qnrh\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.568405 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.568386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.568665 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.568642 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-manifests\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.570617 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.570583 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-tmp\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.570727 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.570655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.570727 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.570709 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-webhook-cert\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.578799 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.578774 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnrh\" (UniqueName: \"kubernetes.io/projected/58bf84af-8a7c-4a1d-8a5c-786eb4c0d926-kube-api-access-7qnrh\") pod \"opendatahub-operator-controller-manager-66c8797c58-k7mmx\" (UID: \"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926\") " pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.637204 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.637176 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:25.638866 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.638836 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.748576 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.748538 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.792436 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:02:25.792410 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bf84af_8a7c_4a1d_8a5c_786eb4c0d926.slice/crio-c169c1b964e1e61b987448bbfefc7d83180367e1382b0b1f9b8fdd15f4df6460 WatchSource:0}: Error finding container c169c1b964e1e61b987448bbfefc7d83180367e1382b0b1f9b8fdd15f4df6460: Status 404 returned error can't find the container with id c169c1b964e1e61b987448bbfefc7d83180367e1382b0b1f9b8fdd15f4df6460 Jul 02 20:02:25.799745 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.799721 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx"] Jul 02 20:02:25.908616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.908578 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:25.999161 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:25.999117 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:26.101478 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:26.101384 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:26.202138 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:26.202103 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:26.434291 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:26.434200 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" event={"ID":"39574b68-e87b-4284-a24a-50415b00e49b","Type":"ContainerStarted","Data":"a64a321f6a26a0dcb5f7d8383b479bf102481e087008376002e9d5ab0343ebc3"} Jul 02 20:02:26.434491 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:26.434359 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:26.435758 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:26.435727 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" event={"ID":"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926","Type":"ContainerStarted","Data":"c169c1b964e1e61b987448bbfefc7d83180367e1382b0b1f9b8fdd15f4df6460"} Jul 02 20:02:26.456358 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:26.456302 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" podStartSLOduration=2.060060996 podStartE2EDuration="4.456282027s" totalImagesPullingTime="2.396221031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:26.45319583 +0000 UTC m=+341.183638235" watchObservedRunningTime="2026-07-02 20:02:26.456282027 +0000 UTC m=+341.186724434" Jul 02 20:02:29.451771 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:29.451731 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" event={"ID":"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926","Type":"ContainerStarted","Data":"73b30ca900b5b818fb5fa65d8a71741b5755ca02375e050cfadd3476909fd9d7"} Jul 02 20:02:30.457445 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:30.457411 2555 generic.go:356] "Generic (PLEG): container finished" podID="58bf84af-8a7c-4a1d-8a5c-786eb4c0d926" containerID="73b30ca900b5b818fb5fa65d8a71741b5755ca02375e050cfadd3476909fd9d7" exitCode=0 Jul 02 20:02:30.457830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:30.457492 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" event={"ID":"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926","Type":"ContainerDied","Data":"73b30ca900b5b818fb5fa65d8a71741b5755ca02375e050cfadd3476909fd9d7"} Jul 02 20:02:31.463779 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:31.463745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" event={"ID":"58bf84af-8a7c-4a1d-8a5c-786eb4c0d926","Type":"ContainerStarted","Data":"ea9c17cf813b6bb7b56786ad8cddcd17d601f922ee43983a7be28a6e6fda2545"} Jul 02 20:02:31.464180 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:31.463996 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:31.496345 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:31.496301 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" podStartSLOduration=2.154963239 podStartE2EDuration="6.496287221s" totalImagesPullingTime="3.294053317s" totalInitContainerRuntime="1.047270665s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:31.493496107 +0000 UTC m=+346.223938528" watchObservedRunningTime="2026-07-02 20:02:31.496287221 +0000 UTC m=+346.226729626" Jul 02 20:02:37.443565 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:37.443533 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58965cb8bc-gxxs8" Jul 02 20:02:42.470298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:42.470210 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66c8797c58-k7mmx" Jul 02 20:02:44.482343 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:44.482303 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:44.702836 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:44.702801 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:45.173684 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.173648 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:45.204754 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.204723 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx"] Jul 02 20:02:45.208050 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.208033 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.211981 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.211952 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 20:02:45.212112 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.211988 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 20:02:45.212112 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.211988 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-975vj\"" Jul 02 20:02:45.212758 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.212744 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 20:02:45.213433 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.213421 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 20:02:45.228927 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.228871 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx"] Jul 02 20:02:45.235296 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.235273 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg4dd\" (UniqueName: \"kubernetes.io/projected/2b7da129-c79f-4590-8941-893c28458af9-kube-api-access-dg4dd\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.235409 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.235316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7da129-c79f-4590-8941-893c28458af9-tls-certs\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.235409 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.235339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b7da129-c79f-4590-8941-893c28458af9-tmp\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.336891 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.336854 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg4dd\" (UniqueName: \"kubernetes.io/projected/2b7da129-c79f-4590-8941-893c28458af9-kube-api-access-dg4dd\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.337068 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.336933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7da129-c79f-4590-8941-893c28458af9-tls-certs\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.337068 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.336957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b7da129-c79f-4590-8941-893c28458af9-tmp\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.337177 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:02:45.337077 2555 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 02 20:02:45.337177 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:02:45.337151 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b7da129-c79f-4590-8941-893c28458af9-tls-certs podName:2b7da129-c79f-4590-8941-893c28458af9 nodeName:}" failed. No retries permitted until 2026-07-02 20:02:45.837132883 +0000 UTC m=+360.567575280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2b7da129-c79f-4590-8941-893c28458af9-tls-certs") pod "kube-auth-proxy-5b7dc9b6d5-spcqx" (UID: "2b7da129-c79f-4590-8941-893c28458af9") : secret "kube-auth-proxy-tls" not found Jul 02 20:02:45.339040 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.339012 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b7da129-c79f-4590-8941-893c28458af9-tmp\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.408095 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.408057 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg4dd\" (UniqueName: \"kubernetes.io/projected/2b7da129-c79f-4590-8941-893c28458af9-kube-api-access-dg4dd\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.487945 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.487845 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:45.629380 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.629336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:45.821161 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.821126 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:45.841661 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.841636 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7da129-c79f-4590-8941-893c28458af9-tls-certs\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.843888 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.843858 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7da129-c79f-4590-8941-893c28458af9-tls-certs\") pod \"kube-auth-proxy-5b7dc9b6d5-spcqx\" (UID: \"2b7da129-c79f-4590-8941-893c28458af9\") " pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:45.932499 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:45.932463 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:46.121225 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:46.121134 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-975vj\"" Jul 02 20:02:46.128455 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:46.128433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" Jul 02 20:02:46.272909 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:46.272860 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx"] Jul 02 20:02:46.274410 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:02:46.274381 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7da129_c79f_4590_8941_893c28458af9.slice/crio-d90407d76f95dc1cd59caf4e347d343861d187fda2c9bf023613587cf2ae7b34 WatchSource:0}: Error finding container d90407d76f95dc1cd59caf4e347d343861d187fda2c9bf023613587cf2ae7b34: Status 404 returned error can't find the container with id d90407d76f95dc1cd59caf4e347d343861d187fda2c9bf023613587cf2ae7b34 Jul 02 20:02:46.532564 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:46.532527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" event={"ID":"2b7da129-c79f-4590-8941-893c28458af9","Type":"ContainerStarted","Data":"d90407d76f95dc1cd59caf4e347d343861d187fda2c9bf023613587cf2ae7b34"} Jul 02 20:02:46.562459 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:46.562422 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:46.774993 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:46.774958 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:47.260759 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:47.260716 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:47.394490 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:47.394452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:48.863996 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:48.863952 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:49.920810 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:49.920788 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 20:02:50.556384 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:50.556350 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" event={"ID":"2b7da129-c79f-4590-8941-893c28458af9","Type":"ContainerStarted","Data":"3a2753a6ee93f01cb7424d0074b74ddab780efd95942bcd0018c2c20292a0af2"} Jul 02 20:02:50.599634 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:50.599565 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b7dc9b6d5-spcqx" podStartSLOduration=1.957578942 podStartE2EDuration="5.599544543s" totalImagesPullingTime="3.641965601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:50.598284055 +0000 UTC m=+365.328726458" watchObservedRunningTime="2026-07-02 20:02:50.599544543 +0000 UTC m=+365.329986960" Jul 02 20:02:52.355711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:52.355674 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:52.456139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:52.456107 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:56.460769 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:56.460735 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:56.590381 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:56.590349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:56.934514 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:56.934486 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:57.473995 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:57.473962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:57.820986 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:57.820948 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:57.927893 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:57.927851 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:02:58.039248 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:02:58.039185 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:02.309451 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:02.309417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:02.393270 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:02.393226 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:02.827516 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:02.827481 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:02.960999 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:02.960952 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:03.050022 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:03.049960 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:30.312983 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:30.312932 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:30.390758 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:30.390721 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:46.055100 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:46.055069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:46.248010 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:46.247975 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:46.377790 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:46.377701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:47.010652 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:47.010605 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:47.275649 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:47.275558 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:55.879778 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:55.879739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:03:55.949064 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:03:55.949032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:04.022388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:04.022347 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:15.374762 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:15.374676 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:15.802425 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:15.802389 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:16.922555 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:16.922512 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:17.029267 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:17.029235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:20.017039 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:20.016998 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:23.309251 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:23.309210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:24.040117 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:24.040085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:26.002456 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:26.002408 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:26.467781 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:26.467691 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:28.461885 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.461839 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b7b6f5887-jt5lw"] Jul 02 20:04:28.465270 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.465249 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.468388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.468370 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 20:04:28.469141 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.469120 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 20:04:28.469141 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.469137 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 20:04:28.469296 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.469121 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 20:04:28.469296 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.469156 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 20:04:28.469575 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.469556 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 20:04:28.469622 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.469600 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6brdh\"" Jul 02 20:04:28.470433 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.470416 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 20:04:28.473972 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.473955 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 20:04:28.483162 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.483141 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7b6f5887-jt5lw"] Jul 02 20:04:28.562360 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.562324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:28.566410 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566390 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-service-ca\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.566488 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566422 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-trusted-ca-bundle\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.566488 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271888b1-3ec6-426f-82ad-90cb7de35a18-console-oauth-config\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.566567 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566526 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271888b1-3ec6-426f-82ad-90cb7de35a18-console-serving-cert\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.566567 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-console-config\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.566655 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbzr\" (UniqueName: \"kubernetes.io/projected/271888b1-3ec6-426f-82ad-90cb7de35a18-kube-api-access-qxbzr\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.566690 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.566665 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-oauth-serving-cert\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667464 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667425 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbzr\" (UniqueName: \"kubernetes.io/projected/271888b1-3ec6-426f-82ad-90cb7de35a18-kube-api-access-qxbzr\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667637 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-oauth-serving-cert\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667637 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-service-ca\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667767 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-trusted-ca-bundle\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667767 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271888b1-3ec6-426f-82ad-90cb7de35a18-console-oauth-config\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667767 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667746 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271888b1-3ec6-426f-82ad-90cb7de35a18-console-serving-cert\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.667961 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.667939 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-console-config\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.668389 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.668367 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-service-ca\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.668488 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.668413 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-oauth-serving-cert\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.668691 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.668673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-trusted-ca-bundle\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.668729 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.668672 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271888b1-3ec6-426f-82ad-90cb7de35a18-console-config\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.670063 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.670044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271888b1-3ec6-426f-82ad-90cb7de35a18-console-oauth-config\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.670346 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.670326 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271888b1-3ec6-426f-82ad-90cb7de35a18-console-serving-cert\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.680986 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.680961 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbzr\" (UniqueName: \"kubernetes.io/projected/271888b1-3ec6-426f-82ad-90cb7de35a18-kube-api-access-qxbzr\") pod \"console-b7b6f5887-jt5lw\" (UID: \"271888b1-3ec6-426f-82ad-90cb7de35a18\") " pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.764267 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.764234 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:28.775500 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.775476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:28.909118 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:28.909090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7b6f5887-jt5lw"] Jul 02 20:04:28.911927 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:04:28.911898 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271888b1_3ec6_426f_82ad_90cb7de35a18.slice/crio-d8bb6a08a28969f1a8d7fbeaaafb60eb20f298cb01cce61bf1a057c878e50dbe WatchSource:0}: Error finding container d8bb6a08a28969f1a8d7fbeaaafb60eb20f298cb01cce61bf1a057c878e50dbe: Status 404 returned error can't find the container with id d8bb6a08a28969f1a8d7fbeaaafb60eb20f298cb01cce61bf1a057c878e50dbe Jul 02 20:04:29.009552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:29.009517 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7b6f5887-jt5lw" event={"ID":"271888b1-3ec6-426f-82ad-90cb7de35a18","Type":"ContainerStarted","Data":"ace55369bfd37d7405717e9f3add8f13075c14a8ce7a44a10661acba624e140d"} Jul 02 20:04:29.009734 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:29.009589 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7b6f5887-jt5lw" event={"ID":"271888b1-3ec6-426f-82ad-90cb7de35a18","Type":"ContainerStarted","Data":"d8bb6a08a28969f1a8d7fbeaaafb60eb20f298cb01cce61bf1a057c878e50dbe"} Jul 02 20:04:29.031613 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:29.031506 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b7b6f5887-jt5lw" podStartSLOduration=1.031488263 podStartE2EDuration="1.031488263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:04:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:04:29.031239392 +0000 UTC m=+463.761681800" watchObservedRunningTime="2026-07-02 20:04:29.031488263 +0000 UTC m=+463.761930668" Jul 02 20:04:29.807924 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:29.807868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:29.909341 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:29.909299 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:30.211658 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:30.211565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:30.313226 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:30.313191 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:32.299242 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.299210 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75"] Jul 02 20:04:32.302733 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.302713 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.305696 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.305675 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 02 20:04:32.305696 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.305685 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:04:32.305858 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.305686 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-km2p4\"" Jul 02 20:04:32.306470 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.306451 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 02 20:04:32.306563 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.306499 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:04:32.313836 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.313817 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75"] Jul 02 20:04:32.316048 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.316025 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:32.404529 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.404490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea60e9e6-8b9b-41cc-9159-8ad174309b79-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.404529 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.404528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvhlh\" (UniqueName: \"kubernetes.io/projected/ea60e9e6-8b9b-41cc-9159-8ad174309b79-kube-api-access-vvhlh\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.404738 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.404555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea60e9e6-8b9b-41cc-9159-8ad174309b79-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.505537 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.505501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea60e9e6-8b9b-41cc-9159-8ad174309b79-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.505537 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.505536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvhlh\" (UniqueName: \"kubernetes.io/projected/ea60e9e6-8b9b-41cc-9159-8ad174309b79-kube-api-access-vvhlh\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.505816 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.505555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea60e9e6-8b9b-41cc-9159-8ad174309b79-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.505816 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:04:32.505662 2555 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 02 20:04:32.505816 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:04:32.505750 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea60e9e6-8b9b-41cc-9159-8ad174309b79-plugin-serving-cert podName:ea60e9e6-8b9b-41cc-9159-8ad174309b79 nodeName:}" failed. No retries permitted until 2026-07-02 20:04:33.005728347 +0000 UTC m=+467.736170739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ea60e9e6-8b9b-41cc-9159-8ad174309b79-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-xvm75" (UID: "ea60e9e6-8b9b-41cc-9159-8ad174309b79") : secret "plugin-serving-cert" not found Jul 02 20:04:32.506190 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.506173 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea60e9e6-8b9b-41cc-9159-8ad174309b79-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:32.515585 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:32.515564 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvhlh\" (UniqueName: \"kubernetes.io/projected/ea60e9e6-8b9b-41cc-9159-8ad174309b79-kube-api-access-vvhlh\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:33.009865 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:33.009821 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea60e9e6-8b9b-41cc-9159-8ad174309b79-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:33.012374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:33.012350 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea60e9e6-8b9b-41cc-9159-8ad174309b79-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-xvm75\" (UID: \"ea60e9e6-8b9b-41cc-9159-8ad174309b79\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:33.060090 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:33.060055 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:33.211661 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:33.211624 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" Jul 02 20:04:33.338838 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:33.338816 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75"] Jul 02 20:04:33.340488 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:04:33.340453 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea60e9e6_8b9b_41cc_9159_8ad174309b79.slice/crio-f349f8a701b7888394caf4b3218eae5e063c714c32fb95e66d7e985eb16908f0 WatchSource:0}: Error finding container f349f8a701b7888394caf4b3218eae5e063c714c32fb95e66d7e985eb16908f0: Status 404 returned error can't find the container with id f349f8a701b7888394caf4b3218eae5e063c714c32fb95e66d7e985eb16908f0 Jul 02 20:04:34.023834 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:34.023777 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:34.037239 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:34.037197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" event={"ID":"ea60e9e6-8b9b-41cc-9159-8ad174309b79","Type":"ContainerStarted","Data":"f349f8a701b7888394caf4b3218eae5e063c714c32fb95e66d7e985eb16908f0"} Jul 02 20:04:34.124393 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:34.124349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:37.666725 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:37.666687 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:37.763030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:37.762977 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:38.776139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:38.776105 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:38.776607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:38.776165 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:38.781103 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:38.781078 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:39.068422 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:39.068343 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b7b6f5887-jt5lw" Jul 02 20:04:39.252994 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:39.252956 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:39.361256 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:39.361056 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:39.465275 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:39.465229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:40.880108 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:40.880063 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:40.978830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:40.978788 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:44.359916 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.359865 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc"] Jul 02 20:04:44.386356 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.386324 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc"] Jul 02 20:04:44.386547 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.386439 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.389819 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.389608 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-26xj4\"" Jul 02 20:04:44.525707 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.525671 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84lx\" (UniqueName: \"kubernetes.io/projected/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-kube-api-access-g84lx\") pod \"kuadrant-operator-controller-manager-86878c769f-zq5xc\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.525916 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.525742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zq5xc\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.627378 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.627269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zq5xc\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.627546 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.627414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g84lx\" (UniqueName: \"kubernetes.io/projected/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-kube-api-access-g84lx\") pod \"kuadrant-operator-controller-manager-86878c769f-zq5xc\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.627735 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.627700 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zq5xc\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.639549 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.639515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84lx\" (UniqueName: \"kubernetes.io/projected/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-kube-api-access-g84lx\") pod \"kuadrant-operator-controller-manager-86878c769f-zq5xc\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:44.700549 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:44.700515 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:04:45.628663 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:45.628619 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:45.726462 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:45.726424 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:49.447329 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:49.447289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:49.548632 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:49.548591 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:49.650045 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:49.650007 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:49.726070 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:49.725983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:52.327306 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:52.327258 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:52.427584 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:52.427543 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:56.624635 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:56.624605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc"] Jul 02 20:04:56.802986 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:04:56.802953 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5db2a0_5ffe_4ae0_9599_575fc42f42df.slice/crio-ddbb0fd50bd823ff46054970b6c9ef6c23de0e38cc5162411a97e70ee99ded0d WatchSource:0}: Error finding container ddbb0fd50bd823ff46054970b6c9ef6c23de0e38cc5162411a97e70ee99ded0d: Status 404 returned error can't find the container with id ddbb0fd50bd823ff46054970b6c9ef6c23de0e38cc5162411a97e70ee99ded0d Jul 02 20:04:57.173107 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:57.173013 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" event={"ID":"ea60e9e6-8b9b-41cc-9159-8ad174309b79","Type":"ContainerStarted","Data":"87134377c6277b6a9d3e4ceb5b7905bf6d5b0dfe13817b93e899b64f361ad362"} Jul 02 20:04:57.174267 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:57.174239 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" event={"ID":"8b5db2a0-5ffe-4ae0-9599-575fc42f42df","Type":"ContainerStarted","Data":"ddbb0fd50bd823ff46054970b6c9ef6c23de0e38cc5162411a97e70ee99ded0d"} Jul 02 20:04:57.193894 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:57.193827 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-xvm75" podStartSLOduration=1.680476737 podStartE2EDuration="25.193811989s" totalImagesPullingTime="23.513335252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:04:57.193420243 +0000 UTC m=+491.923862649" watchObservedRunningTime="2026-07-02 20:04:57.193811989 +0000 UTC m=+491.924254395" Jul 02 20:04:58.857083 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:58.857037 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:04:58.955435 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:04:58.955395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:03.584895 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:03.584841 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:03.686051 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:03.686019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:04.218418 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:04.218382 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" event={"ID":"8b5db2a0-5ffe-4ae0-9599-575fc42f42df","Type":"ContainerStarted","Data":"ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d"} Jul 02 20:05:04.218610 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:04.218521 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:05:04.240462 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:04.240348 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" podStartSLOduration=13.073209465 podStartE2EDuration="20.240334811s" totalImagesPullingTime="7.167125346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:05:04.23907718 +0000 UTC m=+498.969519588" watchObservedRunningTime="2026-07-02 20:05:04.240334811 +0000 UTC m=+498.970777217" Jul 02 20:05:06.547660 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:06.547615 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:06.643513 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:06.643473 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:10.502712 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:10.502676 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:10.602382 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:10.602342 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:15.224733 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:15.224706 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:05:17.836802 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:17.836769 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:17.938037 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:17.938004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:22.588266 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:22.588225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:22.686901 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:22.686835 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:31.743288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:31.743256 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:32.423003 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:32.422971 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:34.036574 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:34.036539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:34.149655 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:34.149625 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:34.205753 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:34.205716 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:34.882469 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:34.882426 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:34.982576 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:34.982539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:35.030166 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.030134 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jdznl"] Jul 02 20:05:35.101463 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.101426 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jdznl"] Jul 02 20:05:35.101852 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.101514 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:05:35.104262 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.104243 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-q8bsr\"" Jul 02 20:05:35.201817 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.201741 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbbx\" (UniqueName: \"kubernetes.io/projected/b92d8b1a-8417-427f-a824-9ca13fb269b6-kube-api-access-7tbbx\") pod \"authorino-75d556bd77-jdznl\" (UID: \"b92d8b1a-8417-427f-a824-9ca13fb269b6\") " pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:05:35.302480 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.302430 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbbx\" (UniqueName: \"kubernetes.io/projected/b92d8b1a-8417-427f-a824-9ca13fb269b6-kube-api-access-7tbbx\") pod \"authorino-75d556bd77-jdznl\" (UID: \"b92d8b1a-8417-427f-a824-9ca13fb269b6\") " pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:05:35.312621 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.312596 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbbx\" (UniqueName: \"kubernetes.io/projected/b92d8b1a-8417-427f-a824-9ca13fb269b6-kube-api-access-7tbbx\") pod \"authorino-75d556bd77-jdznl\" (UID: \"b92d8b1a-8417-427f-a824-9ca13fb269b6\") " pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:05:35.410179 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.410139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:05:35.534792 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:35.534769 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jdznl"] Jul 02 20:05:35.536928 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:05:35.536900 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb92d8b1a_8417_427f_a824_9ca13fb269b6.slice/crio-62e4612dfa24b2420cc5e25a99681265b8570d83947eeb1f3804fb4bfce673e4 WatchSource:0}: Error finding container 62e4612dfa24b2420cc5e25a99681265b8570d83947eeb1f3804fb4bfce673e4: Status 404 returned error can't find the container with id 62e4612dfa24b2420cc5e25a99681265b8570d83947eeb1f3804fb4bfce673e4 Jul 02 20:05:36.369362 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:36.369326 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jdznl" event={"ID":"b92d8b1a-8417-427f-a824-9ca13fb269b6","Type":"ContainerStarted","Data":"62e4612dfa24b2420cc5e25a99681265b8570d83947eeb1f3804fb4bfce673e4"} Jul 02 20:05:39.388056 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:39.388015 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jdznl" event={"ID":"b92d8b1a-8417-427f-a824-9ca13fb269b6","Type":"ContainerStarted","Data":"ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713"} Jul 02 20:05:39.406936 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:39.406868 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jdznl" podStartSLOduration=1.154949448 podStartE2EDuration="4.406851843s" totalImagesPullingTime="3.251902395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:05:39.405079108 +0000 UTC m=+534.135521515" watchObservedRunningTime="2026-07-02 20:05:39.406851843 +0000 UTC m=+534.137294249" Jul 02 20:05:55.132285 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:55.132248 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:05:56.510259 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:05:56.510224 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:06.987599 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:06.987563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:07.204129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.204093 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5hwb"] Jul 02 20:06:07.207806 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.207783 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:07.217520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.217491 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5hwb"] Jul 02 20:06:07.265249 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.265190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:07.307542 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.307509 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8bg5\" (UniqueName: \"kubernetes.io/projected/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4-kube-api-access-q8bg5\") pod \"authorino-5d4b67c446-k5hwb\" (UID: \"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4\") " pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:07.408804 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.408765 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8bg5\" (UniqueName: \"kubernetes.io/projected/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4-kube-api-access-q8bg5\") pod \"authorino-5d4b67c446-k5hwb\" (UID: \"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4\") " pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:07.416916 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.416863 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8bg5\" (UniqueName: \"kubernetes.io/projected/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4-kube-api-access-q8bg5\") pod \"authorino-5d4b67c446-k5hwb\" (UID: \"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4\") " pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:07.440252 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.440223 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5hwb"] Jul 02 20:06:07.440501 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.440489 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:07.465263 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.465222 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b4f68699-jd5q7"] Jul 02 20:06:07.468842 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.468819 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:07.476434 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.476409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b4f68699-jd5q7"] Jul 02 20:06:07.500420 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.500334 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b4f68699-jd5q7"] Jul 02 20:06:07.500738 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:06:07.500706 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-b6wp8], unattached volumes=[], failed to process volumes=[kube-api-access-b6wp8]: context canceled" pod="kuadrant-system/authorino-8b4f68699-jd5q7" podUID="870da3f8-09de-457d-b9be-eb6f2d7e1f83" Jul 02 20:06:07.509929 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.509896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wp8\" (UniqueName: \"kubernetes.io/projected/870da3f8-09de-457d-b9be-eb6f2d7e1f83-kube-api-access-b6wp8\") pod \"authorino-8b4f68699-jd5q7\" (UID: \"870da3f8-09de-457d-b9be-eb6f2d7e1f83\") " pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:07.525612 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.525533 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:07.530274 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.530245 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-858bf7c95f-krdxh"] Jul 02 20:06:07.533306 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.533285 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:07.534164 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.534147 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.537033 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.537012 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 20:06:07.545434 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.545410 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-858bf7c95f-krdxh"] Jul 02 20:06:07.590806 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.590783 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5hwb"] Jul 02 20:06:07.593470 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:06:07.593422 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fde2bb8_c693_42e5_a578_fb3d30b0f5c4.slice/crio-bca495dba5b3a77fe6eb72089b3c6ece8509540223efef29d13d65b4de8c39f7 WatchSource:0}: Error finding container bca495dba5b3a77fe6eb72089b3c6ece8509540223efef29d13d65b4de8c39f7: Status 404 returned error can't find the container with id bca495dba5b3a77fe6eb72089b3c6ece8509540223efef29d13d65b4de8c39f7 Jul 02 20:06:07.610677 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.610649 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txt28\" (UniqueName: \"kubernetes.io/projected/794fad7e-f16b-470a-90f5-76f5adad6612-kube-api-access-txt28\") pod \"authorino-858bf7c95f-krdxh\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.610796 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.610695 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794fad7e-f16b-470a-90f5-76f5adad6612-tls-cert\") pod \"authorino-858bf7c95f-krdxh\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.611019 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.610796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wp8\" (UniqueName: \"kubernetes.io/projected/870da3f8-09de-457d-b9be-eb6f2d7e1f83-kube-api-access-b6wp8\") pod \"authorino-8b4f68699-jd5q7\" (UID: \"870da3f8-09de-457d-b9be-eb6f2d7e1f83\") " pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:07.619298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.619249 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wp8\" (UniqueName: \"kubernetes.io/projected/870da3f8-09de-457d-b9be-eb6f2d7e1f83-kube-api-access-b6wp8\") pod \"authorino-8b4f68699-jd5q7\" (UID: \"870da3f8-09de-457d-b9be-eb6f2d7e1f83\") " pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:07.711565 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.711532 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6wp8\" (UniqueName: \"kubernetes.io/projected/870da3f8-09de-457d-b9be-eb6f2d7e1f83-kube-api-access-b6wp8\") pod \"870da3f8-09de-457d-b9be-eb6f2d7e1f83\" (UID: \"870da3f8-09de-457d-b9be-eb6f2d7e1f83\") " Jul 02 20:06:07.711729 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.711709 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txt28\" (UniqueName: \"kubernetes.io/projected/794fad7e-f16b-470a-90f5-76f5adad6612-kube-api-access-txt28\") pod \"authorino-858bf7c95f-krdxh\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.711776 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.711760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794fad7e-f16b-470a-90f5-76f5adad6612-tls-cert\") pod \"authorino-858bf7c95f-krdxh\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.713682 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.713656 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870da3f8-09de-457d-b9be-eb6f2d7e1f83-kube-api-access-b6wp8" (OuterVolumeSpecName: "kube-api-access-b6wp8") pod "870da3f8-09de-457d-b9be-eb6f2d7e1f83" (UID: "870da3f8-09de-457d-b9be-eb6f2d7e1f83"). InnerVolumeSpecName "kube-api-access-b6wp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:06:07.714058 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.714041 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794fad7e-f16b-470a-90f5-76f5adad6612-tls-cert\") pod \"authorino-858bf7c95f-krdxh\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.719575 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.719557 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txt28\" (UniqueName: \"kubernetes.io/projected/794fad7e-f16b-470a-90f5-76f5adad6612-kube-api-access-txt28\") pod \"authorino-858bf7c95f-krdxh\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.812523 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.812450 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6wp8\" (UniqueName: \"kubernetes.io/projected/870da3f8-09de-457d-b9be-eb6f2d7e1f83-kube-api-access-b6wp8\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:06:07.843790 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.843760 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:06:07.978407 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:07.978381 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-858bf7c95f-krdxh"] Jul 02 20:06:07.980973 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:06:07.980941 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod794fad7e_f16b_470a_90f5_76f5adad6612.slice/crio-8b1e58f465adb5886a27d45011fed93451451b09bb30065c4c6d2fd4586f9af5 WatchSource:0}: Error finding container 8b1e58f465adb5886a27d45011fed93451451b09bb30065c4c6d2fd4586f9af5: Status 404 returned error can't find the container with id 8b1e58f465adb5886a27d45011fed93451451b09bb30065c4c6d2fd4586f9af5 Jul 02 20:06:08.532736 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.532703 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858bf7c95f-krdxh" event={"ID":"794fad7e-f16b-470a-90f5-76f5adad6612","Type":"ContainerStarted","Data":"b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3"} Jul 02 20:06:08.533223 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.532759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858bf7c95f-krdxh" event={"ID":"794fad7e-f16b-470a-90f5-76f5adad6612","Type":"ContainerStarted","Data":"8b1e58f465adb5886a27d45011fed93451451b09bb30065c4c6d2fd4586f9af5"} Jul 02 20:06:08.534822 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.534787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" event={"ID":"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4","Type":"ContainerStarted","Data":"bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7"} Jul 02 20:06:08.534973 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.534833 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" event={"ID":"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4","Type":"ContainerStarted","Data":"bca495dba5b3a77fe6eb72089b3c6ece8509540223efef29d13d65b4de8c39f7"} Jul 02 20:06:08.534973 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.534855 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" podUID="7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" containerName="authorino" containerID="cri-o://bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7" gracePeriod=30 Jul 02 20:06:08.534973 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.534898 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b4f68699-jd5q7" Jul 02 20:06:08.549771 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.549692 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-858bf7c95f-krdxh" podStartSLOduration=1.113637607 podStartE2EDuration="1.549671066s" totalImagesPullingTime="436.033459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:06:08.548833125 +0000 UTC m=+563.279275531" watchObservedRunningTime="2026-07-02 20:06:08.549671066 +0000 UTC m=+563.280113474" Jul 02 20:06:08.564843 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.564784 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" podStartSLOduration=1.205424263 podStartE2EDuration="1.564763839s" totalImagesPullingTime="359.339576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:06:08.563008912 +0000 UTC m=+563.293451319" watchObservedRunningTime="2026-07-02 20:06:08.564763839 +0000 UTC m=+563.295206245" Jul 02 20:06:08.577092 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.577060 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jdznl"] Jul 02 20:06:08.577304 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.577266 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jdznl" podUID="b92d8b1a-8417-427f-a824-9ca13fb269b6" containerName="authorino" containerID="cri-o://ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713" gracePeriod=30 Jul 02 20:06:08.597098 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.597068 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b4f68699-jd5q7"] Jul 02 20:06:08.600350 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.600311 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b4f68699-jd5q7"] Jul 02 20:06:08.833824 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.833801 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:08.839025 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.839002 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:06:08.923128 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.923093 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tbbx\" (UniqueName: \"kubernetes.io/projected/b92d8b1a-8417-427f-a824-9ca13fb269b6-kube-api-access-7tbbx\") pod \"b92d8b1a-8417-427f-a824-9ca13fb269b6\" (UID: \"b92d8b1a-8417-427f-a824-9ca13fb269b6\") " Jul 02 20:06:08.923272 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.923197 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8bg5\" (UniqueName: \"kubernetes.io/projected/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4-kube-api-access-q8bg5\") pod \"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4\" (UID: \"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4\") " Jul 02 20:06:08.925277 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.925244 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92d8b1a-8417-427f-a824-9ca13fb269b6-kube-api-access-7tbbx" (OuterVolumeSpecName: "kube-api-access-7tbbx") pod "b92d8b1a-8417-427f-a824-9ca13fb269b6" (UID: "b92d8b1a-8417-427f-a824-9ca13fb269b6"). InnerVolumeSpecName "kube-api-access-7tbbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:06:08.925396 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:08.925283 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4-kube-api-access-q8bg5" (OuterVolumeSpecName: "kube-api-access-q8bg5") pod "7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" (UID: "7fde2bb8-c693-42e5-a578-fb3d30b0f5c4"). InnerVolumeSpecName "kube-api-access-q8bg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:06:09.023989 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.023956 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tbbx\" (UniqueName: \"kubernetes.io/projected/b92d8b1a-8417-427f-a824-9ca13fb269b6-kube-api-access-7tbbx\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:06:09.023989 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.023981 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8bg5\" (UniqueName: \"kubernetes.io/projected/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4-kube-api-access-q8bg5\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:06:09.540432 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.540398 2555 generic.go:356] "Generic (PLEG): container finished" podID="b92d8b1a-8417-427f-a824-9ca13fb269b6" containerID="ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713" exitCode=0 Jul 02 20:06:09.540849 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.540441 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jdznl" Jul 02 20:06:09.540849 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.540480 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jdznl" event={"ID":"b92d8b1a-8417-427f-a824-9ca13fb269b6","Type":"ContainerDied","Data":"ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713"} Jul 02 20:06:09.540849 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.540520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jdznl" event={"ID":"b92d8b1a-8417-427f-a824-9ca13fb269b6","Type":"ContainerDied","Data":"62e4612dfa24b2420cc5e25a99681265b8570d83947eeb1f3804fb4bfce673e4"} Jul 02 20:06:09.540849 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.540537 2555 scope.go:117] "RemoveContainer" containerID="ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713" Jul 02 20:06:09.541756 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.541692 2555 generic.go:356] "Generic (PLEG): container finished" podID="7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" containerID="bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7" exitCode=0 Jul 02 20:06:09.541756 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.541744 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" Jul 02 20:06:09.541869 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.541792 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" event={"ID":"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4","Type":"ContainerDied","Data":"bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7"} Jul 02 20:06:09.541869 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.541830 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-k5hwb" event={"ID":"7fde2bb8-c693-42e5-a578-fb3d30b0f5c4","Type":"ContainerDied","Data":"bca495dba5b3a77fe6eb72089b3c6ece8509540223efef29d13d65b4de8c39f7"} Jul 02 20:06:09.549647 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.549631 2555 scope.go:117] "RemoveContainer" containerID="ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713" Jul 02 20:06:09.549947 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:06:09.549930 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713\": container with ID starting with ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713 not found: ID does not exist" containerID="ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713" Jul 02 20:06:09.550032 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.549961 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713"} err="failed to get container status \"ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713\": rpc error: code = NotFound desc = could not find container \"ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713\": container with ID starting with ad3b8f1e2abcc3de89cc70a632e60ec81b98080950a253a0a778d24095647713 not found: ID does not exist" Jul 02 20:06:09.550032 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.549984 2555 scope.go:117] "RemoveContainer" containerID="bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7" Jul 02 20:06:09.557422 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.557406 2555 scope.go:117] "RemoveContainer" containerID="bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7" Jul 02 20:06:09.557660 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:06:09.557643 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7\": container with ID starting with bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7 not found: ID does not exist" containerID="bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7" Jul 02 20:06:09.557698 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.557667 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7"} err="failed to get container status \"bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7\": rpc error: code = NotFound desc = could not find container \"bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7\": container with ID starting with bd25e4b275b122e93074381109f26af9f5b36dabcf3716e24acaf8a3d17c7ea7 not found: ID does not exist" Jul 02 20:06:09.563396 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.563375 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5hwb"] Jul 02 20:06:09.566814 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.566794 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-k5hwb"] Jul 02 20:06:09.576355 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.576333 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jdznl"] Jul 02 20:06:09.581336 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.581316 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jdznl"] Jul 02 20:06:09.872666 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.872635 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" path="/var/lib/kubelet/pods/7fde2bb8-c693-42e5-a578-fb3d30b0f5c4/volumes" Jul 02 20:06:09.873008 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.872994 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="870da3f8-09de-457d-b9be-eb6f2d7e1f83" path="/var/lib/kubelet/pods/870da3f8-09de-457d-b9be-eb6f2d7e1f83/volumes" Jul 02 20:06:09.873210 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:09.873199 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92d8b1a-8417-427f-a824-9ca13fb269b6" path="/var/lib/kubelet/pods/b92d8b1a-8417-427f-a824-9ca13fb269b6/volumes" Jul 02 20:06:12.387921 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:12.387857 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:12.441139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:12.441099 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:12.831987 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:12.831958 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:12.911150 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:12.911114 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:12.972705 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:12.972664 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:16.291803 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:16.291770 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:16.381837 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:16.381801 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:45.760691 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:45.760659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:06:45.761764 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:45.761739 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:06:47.260400 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:47.260353 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:48.693709 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:48.693660 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:58.876393 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:58.876354 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:06:58.975669 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:06:58.975626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:20.193897 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.193799 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb"] Jul 02 20:07:20.194381 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.194365 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92d8b1a-8417-427f-a824-9ca13fb269b6" containerName="authorino" Jul 02 20:07:20.194426 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.194384 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92d8b1a-8417-427f-a824-9ca13fb269b6" containerName="authorino" Jul 02 20:07:20.194426 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.194410 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" containerName="authorino" Jul 02 20:07:20.194426 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.194419 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" containerName="authorino" Jul 02 20:07:20.194537 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.194525 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fde2bb8-c693-42e5-a578-fb3d30b0f5c4" containerName="authorino" Jul 02 20:07:20.194579 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.194540 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92d8b1a-8417-427f-a824-9ca13fb269b6" containerName="authorino" Jul 02 20:07:20.197831 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.197808 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.200365 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.200343 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 20:07:20.201334 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.201314 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d2n2k\"" Jul 02 20:07:20.201334 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.201327 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 20:07:20.201497 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.201353 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 20:07:20.206779 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.206759 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb"] Jul 02 20:07:20.284145 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.284107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq4h7\" (UniqueName: \"kubernetes.io/projected/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-kube-api-access-fq4h7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.284322 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.284156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.284322 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.284187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.284322 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.284238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.284322 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.284270 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.284322 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.284290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385224 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385224 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385234 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385444 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq4h7\" (UniqueName: \"kubernetes.io/projected/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-kube-api-access-fq4h7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385444 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385540 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385446 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385540 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385644 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385608 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385780 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385760 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.385895 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.385856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.387629 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.387604 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.387750 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.387616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.395675 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.395654 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq4h7\" (UniqueName: \"kubernetes.io/projected/f7707a2f-b964-4c47-a1ba-5b257d60d1e6-kube-api-access-fq4h7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb\" (UID: \"f7707a2f-b964-4c47-a1ba-5b257d60d1e6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.509736 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.509705 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:20.645103 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.645063 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:20.651311 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.651279 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb"] Jul 02 20:07:20.652297 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:07:20.652266 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7707a2f_b964_4c47_a1ba_5b257d60d1e6.slice/crio-d3871e5d5598eb73ad04a0ddee7c32cffc634d81de0bb6779b15197b0004da42 WatchSource:0}: Error finding container d3871e5d5598eb73ad04a0ddee7c32cffc634d81de0bb6779b15197b0004da42: Status 404 returned error can't find the container with id d3871e5d5598eb73ad04a0ddee7c32cffc634d81de0bb6779b15197b0004da42 Jul 02 20:07:20.653735 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.653712 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:07:20.900899 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:20.900746 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" event={"ID":"f7707a2f-b964-4c47-a1ba-5b257d60d1e6","Type":"ContainerStarted","Data":"d3871e5d5598eb73ad04a0ddee7c32cffc634d81de0bb6779b15197b0004da42"} Jul 02 20:07:22.911563 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:22.911527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" event={"ID":"f7707a2f-b964-4c47-a1ba-5b257d60d1e6","Type":"ContainerStarted","Data":"f73dcf4317dba0408421bb61297402f6c9fc1368eab45fc4abc769facf5e020b"} Jul 02 20:07:22.929236 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:22.929162 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" podStartSLOduration=1.689478182 podStartE2EDuration="2.929145079s" totalImagesPullingTime="1.239666897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:07:22.928196586 +0000 UTC m=+637.658639027" watchObservedRunningTime="2026-07-02 20:07:22.929145079 +0000 UTC m=+637.659587485" Jul 02 20:07:30.510758 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:30.510721 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:30.511329 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:30.510791 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:30.523179 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:30.523148 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:30.958798 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:30.958730 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb" Jul 02 20:07:36.218076 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:36.218034 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:07:47.740208 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:07:47.740166 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:12.633650 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:12.633615 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:17.919629 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:17.919589 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:23.028887 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:23.028846 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:28.999801 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:28.999766 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:34.648771 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:34.648739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:59.090340 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:59.090303 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:08:59.144368 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:08:59.144324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:09:19.486525 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.486488 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fdcb7d8bb-khkv4"] Jul 02 20:09:19.490151 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.490128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.498330 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.497948 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fdcb7d8bb-khkv4"] Jul 02 20:09:19.591158 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.591121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a79e17-23d2-4bdc-a181-6ed7883235b8-tls-cert\") pod \"authorino-fdcb7d8bb-khkv4\" (UID: \"74a79e17-23d2-4bdc-a181-6ed7883235b8\") " pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.591328 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.591167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rpxz\" (UniqueName: \"kubernetes.io/projected/74a79e17-23d2-4bdc-a181-6ed7883235b8-kube-api-access-5rpxz\") pod \"authorino-fdcb7d8bb-khkv4\" (UID: \"74a79e17-23d2-4bdc-a181-6ed7883235b8\") " pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.692368 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.692330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a79e17-23d2-4bdc-a181-6ed7883235b8-tls-cert\") pod \"authorino-fdcb7d8bb-khkv4\" (UID: \"74a79e17-23d2-4bdc-a181-6ed7883235b8\") " pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.692529 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.692392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rpxz\" (UniqueName: \"kubernetes.io/projected/74a79e17-23d2-4bdc-a181-6ed7883235b8-kube-api-access-5rpxz\") pod \"authorino-fdcb7d8bb-khkv4\" (UID: \"74a79e17-23d2-4bdc-a181-6ed7883235b8\") " pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.694641 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.694610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a79e17-23d2-4bdc-a181-6ed7883235b8-tls-cert\") pod \"authorino-fdcb7d8bb-khkv4\" (UID: \"74a79e17-23d2-4bdc-a181-6ed7883235b8\") " pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.701787 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.701758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rpxz\" (UniqueName: \"kubernetes.io/projected/74a79e17-23d2-4bdc-a181-6ed7883235b8-kube-api-access-5rpxz\") pod \"authorino-fdcb7d8bb-khkv4\" (UID: \"74a79e17-23d2-4bdc-a181-6ed7883235b8\") " pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.800583 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.800550 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" Jul 02 20:09:19.865715 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.865642 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:09:19.942579 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.942555 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fdcb7d8bb-khkv4"] Jul 02 20:09:19.944808 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:09:19.944780 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74a79e17_23d2_4bdc_a181_6ed7883235b8.slice/crio-56c10a940011aa999afab1c7d8d2b8866026cff3b972819c300418c2127ad2bf WatchSource:0}: Error finding container 56c10a940011aa999afab1c7d8d2b8866026cff3b972819c300418c2127ad2bf: Status 404 returned error can't find the container with id 56c10a940011aa999afab1c7d8d2b8866026cff3b972819c300418c2127ad2bf Jul 02 20:09:19.951288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:19.951259 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:09:20.497581 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:20.497552 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" event={"ID":"74a79e17-23d2-4bdc-a181-6ed7883235b8","Type":"ContainerStarted","Data":"56c10a940011aa999afab1c7d8d2b8866026cff3b972819c300418c2127ad2bf"} Jul 02 20:09:21.103314 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.103202 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:09:21.190554 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.190469 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:09:21.506979 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.506937 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" event={"ID":"74a79e17-23d2-4bdc-a181-6ed7883235b8","Type":"ContainerStarted","Data":"908226a1420f84f038b7543bd52f91a7c0f679d9a762e7c59d30432e82ecc892"} Jul 02 20:09:21.527045 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.526987 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fdcb7d8bb-khkv4" podStartSLOduration=2.006228308 podStartE2EDuration="2.526952164s" totalImagesPullingTime="520.723856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:09:21.523624897 +0000 UTC m=+756.254067307" watchObservedRunningTime="2026-07-02 20:09:21.526952164 +0000 UTC m=+756.257394571" Jul 02 20:09:21.557667 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.557577 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858bf7c95f-krdxh"] Jul 02 20:09:21.558121 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.558088 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-858bf7c95f-krdxh" podUID="794fad7e-f16b-470a-90f5-76f5adad6612" containerName="authorino" containerID="cri-o://b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3" gracePeriod=30 Jul 02 20:09:21.808890 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.808841 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:09:21.918210 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.918177 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txt28\" (UniqueName: \"kubernetes.io/projected/794fad7e-f16b-470a-90f5-76f5adad6612-kube-api-access-txt28\") pod \"794fad7e-f16b-470a-90f5-76f5adad6612\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " Jul 02 20:09:21.918395 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.918248 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794fad7e-f16b-470a-90f5-76f5adad6612-tls-cert\") pod \"794fad7e-f16b-470a-90f5-76f5adad6612\" (UID: \"794fad7e-f16b-470a-90f5-76f5adad6612\") " Jul 02 20:09:21.920305 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.920269 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794fad7e-f16b-470a-90f5-76f5adad6612-kube-api-access-txt28" (OuterVolumeSpecName: "kube-api-access-txt28") pod "794fad7e-f16b-470a-90f5-76f5adad6612" (UID: "794fad7e-f16b-470a-90f5-76f5adad6612"). InnerVolumeSpecName "kube-api-access-txt28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:09:21.929403 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:21.929367 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794fad7e-f16b-470a-90f5-76f5adad6612-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "794fad7e-f16b-470a-90f5-76f5adad6612" (UID: "794fad7e-f16b-470a-90f5-76f5adad6612"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:09:22.019744 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.019674 2555 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794fad7e-f16b-470a-90f5-76f5adad6612-tls-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:09:22.019744 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.019716 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txt28\" (UniqueName: \"kubernetes.io/projected/794fad7e-f16b-470a-90f5-76f5adad6612-kube-api-access-txt28\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:09:22.513359 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.513322 2555 generic.go:356] "Generic (PLEG): container finished" podID="794fad7e-f16b-470a-90f5-76f5adad6612" containerID="b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3" exitCode=0 Jul 02 20:09:22.513815 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.513370 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858bf7c95f-krdxh" Jul 02 20:09:22.513815 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.513409 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858bf7c95f-krdxh" event={"ID":"794fad7e-f16b-470a-90f5-76f5adad6612","Type":"ContainerDied","Data":"b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3"} Jul 02 20:09:22.513815 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.513452 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858bf7c95f-krdxh" event={"ID":"794fad7e-f16b-470a-90f5-76f5adad6612","Type":"ContainerDied","Data":"8b1e58f465adb5886a27d45011fed93451451b09bb30065c4c6d2fd4586f9af5"} Jul 02 20:09:22.513815 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.513469 2555 scope.go:117] "RemoveContainer" containerID="b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3" Jul 02 20:09:22.522927 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.522913 2555 scope.go:117] "RemoveContainer" containerID="b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3" Jul 02 20:09:22.523224 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:09:22.523182 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3\": container with ID starting with b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3 not found: ID does not exist" containerID="b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3" Jul 02 20:09:22.523265 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.523234 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3"} err="failed to get container status \"b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3\": rpc error: code = NotFound desc = could not find container \"b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3\": container with ID starting with b8746dab48cde4db53536bb69ec09f84ac712859ace811de3a54719c3686fcc3 not found: ID does not exist" Jul 02 20:09:22.537974 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.537947 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858bf7c95f-krdxh"] Jul 02 20:09:22.543783 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:22.543761 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-858bf7c95f-krdxh"] Jul 02 20:09:23.872630 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:09:23.872594 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="794fad7e-f16b-470a-90f5-76f5adad6612" path="/var/lib/kubelet/pods/794fad7e-f16b-470a-90f5-76f5adad6612/volumes" Jul 02 20:10:32.009770 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:10:32.009672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:10:33.588292 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:10:33.588244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:09.205857 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:09.205825 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:09.303611 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:09.303579 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:09.436359 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:09.436324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:11.108411 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:11.108377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:12.999853 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:12.999810 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:15.219563 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:15.219531 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:15.284977 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:15.284948 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:15.378599 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:15.378564 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:15.476121 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:15.476044 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:15.575727 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:15.575693 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:21.286059 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:21.286016 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:21.375894 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:21.375847 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:11:45.792587 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:45.792553 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:11:45.794807 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:11:45.794786 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:12:27.566896 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:12:27.566839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:15:00.148120 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.148080 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717055-vmrpl"] Jul 02 20:15:00.148572 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.148465 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794fad7e-f16b-470a-90f5-76f5adad6612" containerName="authorino" Jul 02 20:15:00.148572 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.148476 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="794fad7e-f16b-470a-90f5-76f5adad6612" containerName="authorino" Jul 02 20:15:00.148572 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.148549 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="794fad7e-f16b-470a-90f5-76f5adad6612" containerName="authorino" Jul 02 20:15:00.151723 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.151697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:00.155121 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.155094 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cwtmg\"" Jul 02 20:15:00.170564 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.170521 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/86e78d2e-7845-4987-9455-dd695576e39d-kube-api-access-vcn8l\") pod \"maas-api-key-cleanup-29717055-vmrpl\" (UID: \"86e78d2e-7845-4987-9455-dd695576e39d\") " pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:00.170719 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.170564 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717055-vmrpl"] Jul 02 20:15:00.271125 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.271074 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/86e78d2e-7845-4987-9455-dd695576e39d-kube-api-access-vcn8l\") pod \"maas-api-key-cleanup-29717055-vmrpl\" (UID: \"86e78d2e-7845-4987-9455-dd695576e39d\") " pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:00.280539 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.280500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/86e78d2e-7845-4987-9455-dd695576e39d-kube-api-access-vcn8l\") pod \"maas-api-key-cleanup-29717055-vmrpl\" (UID: \"86e78d2e-7845-4987-9455-dd695576e39d\") " pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:00.466472 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.466373 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:00.621438 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.621399 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717055-vmrpl"] Jul 02 20:15:00.625668 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:15:00.625626 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e78d2e_7845_4987_9455_dd695576e39d.slice/crio-7b29338f5fa01ce2b33d34066bbb1a6d67d2878d88f0e1b6213f294aa6d8aa06 WatchSource:0}: Error finding container 7b29338f5fa01ce2b33d34066bbb1a6d67d2878d88f0e1b6213f294aa6d8aa06: Status 404 returned error can't find the container with id 7b29338f5fa01ce2b33d34066bbb1a6d67d2878d88f0e1b6213f294aa6d8aa06 Jul 02 20:15:00.627663 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:00.627643 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:15:01.180216 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:01.180175 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" event={"ID":"86e78d2e-7845-4987-9455-dd695576e39d","Type":"ContainerStarted","Data":"7b29338f5fa01ce2b33d34066bbb1a6d67d2878d88f0e1b6213f294aa6d8aa06"} Jul 02 20:15:04.197500 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:04.197467 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" event={"ID":"86e78d2e-7845-4987-9455-dd695576e39d","Type":"ContainerStarted","Data":"0939c61b9558e2ec61890ed74906114e6e7196b8963f9d4a6efbee81a1e78182"} Jul 02 20:15:04.213252 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:04.213201 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" podStartSLOduration=1.500160071 podStartE2EDuration="4.213185375s" totalImagesPullingTime="2.713025304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:15:04.212041602 +0000 UTC m=+1098.942484009" watchObservedRunningTime="2026-07-02 20:15:04.213185375 +0000 UTC m=+1098.943627780" Jul 02 20:15:05.205779 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:05.205740 2555 generic.go:356] "Generic (PLEG): container finished" podID="86e78d2e-7845-4987-9455-dd695576e39d" containerID="0939c61b9558e2ec61890ed74906114e6e7196b8963f9d4a6efbee81a1e78182" exitCode=0 Jul 02 20:15:05.206208 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:05.205840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" event={"ID":"86e78d2e-7845-4987-9455-dd695576e39d","Type":"ContainerDied","Data":"0939c61b9558e2ec61890ed74906114e6e7196b8963f9d4a6efbee81a1e78182"} Jul 02 20:15:06.339431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:06.339402 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:06.424478 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:06.424443 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/86e78d2e-7845-4987-9455-dd695576e39d-kube-api-access-vcn8l\") pod \"86e78d2e-7845-4987-9455-dd695576e39d\" (UID: \"86e78d2e-7845-4987-9455-dd695576e39d\") " Jul 02 20:15:06.426728 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:06.426702 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e78d2e-7845-4987-9455-dd695576e39d-kube-api-access-vcn8l" (OuterVolumeSpecName: "kube-api-access-vcn8l") pod "86e78d2e-7845-4987-9455-dd695576e39d" (UID: "86e78d2e-7845-4987-9455-dd695576e39d"). InnerVolumeSpecName "kube-api-access-vcn8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:15:06.525592 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:06.525556 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcn8l\" (UniqueName: \"kubernetes.io/projected/86e78d2e-7845-4987-9455-dd695576e39d-kube-api-access-vcn8l\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:15:07.216414 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:07.216380 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" Jul 02 20:15:07.216414 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:07.216393 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717055-vmrpl" event={"ID":"86e78d2e-7845-4987-9455-dd695576e39d","Type":"ContainerDied","Data":"7b29338f5fa01ce2b33d34066bbb1a6d67d2878d88f0e1b6213f294aa6d8aa06"} Jul 02 20:15:07.216630 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:07.216445 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b29338f5fa01ce2b33d34066bbb1a6d67d2878d88f0e1b6213f294aa6d8aa06" Jul 02 20:15:11.716604 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:11.716559 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc"] Jul 02 20:15:11.717021 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:11.716853 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" podUID="8b5db2a0-5ffe-4ae0-9599-575fc42f42df" containerName="manager" containerID="cri-o://ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d" gracePeriod=10 Jul 02 20:15:14.675936 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.675911 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:15:14.803322 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.803230 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g84lx\" (UniqueName: \"kubernetes.io/projected/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-kube-api-access-g84lx\") pod \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " Jul 02 20:15:14.803468 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.803362 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-extensions-socket-volume\") pod \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\" (UID: \"8b5db2a0-5ffe-4ae0-9599-575fc42f42df\") " Jul 02 20:15:14.803716 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.803693 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8b5db2a0-5ffe-4ae0-9599-575fc42f42df" (UID: "8b5db2a0-5ffe-4ae0-9599-575fc42f42df"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:15:14.805312 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.805287 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-kube-api-access-g84lx" (OuterVolumeSpecName: "kube-api-access-g84lx") pod "8b5db2a0-5ffe-4ae0-9599-575fc42f42df" (UID: "8b5db2a0-5ffe-4ae0-9599-575fc42f42df"). InnerVolumeSpecName "kube-api-access-g84lx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:15:14.904635 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.904596 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-extensions-socket-volume\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:15:14.904842 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:14.904695 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g84lx\" (UniqueName: \"kubernetes.io/projected/8b5db2a0-5ffe-4ae0-9599-575fc42f42df-kube-api-access-g84lx\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:15:15.259691 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.259652 2555 generic.go:356] "Generic (PLEG): container finished" podID="8b5db2a0-5ffe-4ae0-9599-575fc42f42df" containerID="ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d" exitCode=0 Jul 02 20:15:15.259691 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.259691 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" Jul 02 20:15:15.259911 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.259723 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" event={"ID":"8b5db2a0-5ffe-4ae0-9599-575fc42f42df","Type":"ContainerDied","Data":"ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d"} Jul 02 20:15:15.259911 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.259766 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc" event={"ID":"8b5db2a0-5ffe-4ae0-9599-575fc42f42df","Type":"ContainerDied","Data":"ddbb0fd50bd823ff46054970b6c9ef6c23de0e38cc5162411a97e70ee99ded0d"} Jul 02 20:15:15.259911 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.259791 2555 scope.go:117] "RemoveContainer" containerID="ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d" Jul 02 20:15:15.271430 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.271391 2555 scope.go:117] "RemoveContainer" containerID="ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d" Jul 02 20:15:15.272113 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:15:15.272085 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d\": container with ID starting with ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d not found: ID does not exist" containerID="ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d" Jul 02 20:15:15.272207 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.272125 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d"} err="failed to get container status \"ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d\": rpc error: code = NotFound desc = could not find container \"ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d\": container with ID starting with ca43f05ffee599c0eb88fa242a69a7e9eada7022cc3c319dc2ed198ac948629d not found: ID does not exist" Jul 02 20:15:15.281721 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.281694 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc"] Jul 02 20:15:15.286265 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.286242 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zq5xc"] Jul 02 20:15:15.872850 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:15:15.872819 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5db2a0-5ffe-4ae0-9599-575fc42f42df" path="/var/lib/kubelet/pods/8b5db2a0-5ffe-4ae0-9599-575fc42f42df/volumes" Jul 02 20:16:12.958742 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.958662 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j"] Jul 02 20:16:12.959202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.959092 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e78d2e-7845-4987-9455-dd695576e39d" containerName="cleanup" Jul 02 20:16:12.959202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.959107 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e78d2e-7845-4987-9455-dd695576e39d" containerName="cleanup" Jul 02 20:16:12.959202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.959122 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5db2a0-5ffe-4ae0-9599-575fc42f42df" containerName="manager" Jul 02 20:16:12.959202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.959128 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5db2a0-5ffe-4ae0-9599-575fc42f42df" containerName="manager" Jul 02 20:16:12.959202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.959190 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5db2a0-5ffe-4ae0-9599-575fc42f42df" containerName="manager" Jul 02 20:16:12.959202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.959203 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e78d2e-7845-4987-9455-dd695576e39d" containerName="cleanup" Jul 02 20:16:12.963343 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.963324 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:12.965808 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.965787 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-26xj4\"" Jul 02 20:16:12.974902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:12.974854 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j"] Jul 02 20:16:13.066380 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.066335 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6spwt\" (UniqueName: \"kubernetes.io/projected/725de289-2c28-48da-b152-23b647861d86-kube-api-access-6spwt\") pod \"kuadrant-operator-controller-manager-86878c769f-brc6j\" (UID: \"725de289-2c28-48da-b152-23b647861d86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.066596 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.066485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/725de289-2c28-48da-b152-23b647861d86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-brc6j\" (UID: \"725de289-2c28-48da-b152-23b647861d86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.167374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.167337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6spwt\" (UniqueName: \"kubernetes.io/projected/725de289-2c28-48da-b152-23b647861d86-kube-api-access-6spwt\") pod \"kuadrant-operator-controller-manager-86878c769f-brc6j\" (UID: \"725de289-2c28-48da-b152-23b647861d86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.167549 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.167445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/725de289-2c28-48da-b152-23b647861d86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-brc6j\" (UID: \"725de289-2c28-48da-b152-23b647861d86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.167793 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.167775 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/725de289-2c28-48da-b152-23b647861d86-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-brc6j\" (UID: \"725de289-2c28-48da-b152-23b647861d86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.176103 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.176081 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6spwt\" (UniqueName: \"kubernetes.io/projected/725de289-2c28-48da-b152-23b647861d86-kube-api-access-6spwt\") pod \"kuadrant-operator-controller-manager-86878c769f-brc6j\" (UID: \"725de289-2c28-48da-b152-23b647861d86\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.273312 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.273274 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.409499 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.409312 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j"] Jul 02 20:16:13.412629 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:16:13.412599 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725de289_2c28_48da_b152_23b647861d86.slice/crio-3072f53588495b4ca316e754212047245fa0f25fdf2fd98a592fddb4bb00e651 WatchSource:0}: Error finding container 3072f53588495b4ca316e754212047245fa0f25fdf2fd98a592fddb4bb00e651: Status 404 returned error can't find the container with id 3072f53588495b4ca316e754212047245fa0f25fdf2fd98a592fddb4bb00e651 Jul 02 20:16:13.546578 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.546483 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" event={"ID":"725de289-2c28-48da-b152-23b647861d86","Type":"ContainerStarted","Data":"eba3c37ab5608ea28f41785bf25ac1047c11f445f458f6f9837d2c1803e91ccf"} Jul 02 20:16:13.546578 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.546537 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" event={"ID":"725de289-2c28-48da-b152-23b647861d86","Type":"ContainerStarted","Data":"3072f53588495b4ca316e754212047245fa0f25fdf2fd98a592fddb4bb00e651"} Jul 02 20:16:13.546578 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.546559 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:13.566080 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:13.566028 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" podStartSLOduration=1.566009277 podStartE2EDuration="1.566009277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:16:13.565184013 +0000 UTC m=+1168.295626425" watchObservedRunningTime="2026-07-02 20:16:13.566009277 +0000 UTC m=+1168.296451683" Jul 02 20:16:24.553989 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:24.553957 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-brc6j" Jul 02 20:16:37.691157 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:37.691126 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:16:45.825006 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:45.824979 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:16:45.828049 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:16:45.828027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:17:52.953951 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:17:52.953915 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:17:53.980633 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:17:53.980576 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:20:28.992804 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:20:28.992769 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:00.530287 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:21:00.530250 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:21:45.858677 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:21:45.858645 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:21:45.863096 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:21:45.863074 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:22:01.975785 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:01.975744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:10.348088 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:10.348003 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:18.644273 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:18.644239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:23.769976 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:23.769942 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:26.866970 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:26.866923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:26.956213 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:26.956185 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:27.324593 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:27.324562 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:32.960357 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:32.960310 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:33.032432 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:33.032395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:33.263171 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:33.263140 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:33.429112 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:33.429082 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:34.518251 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:34.518207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:34.607605 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:34.607577 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:34.677371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:34.677334 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:35.065756 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:35.065722 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:35.166892 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:35.166855 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:35.267417 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:35.267385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:37.244795 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:37.244755 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:39.829923 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:39.829868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:40.075770 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:40.075731 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:40.187127 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:40.187036 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:40.324940 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:40.324897 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:43.306344 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:43.306309 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:46.021186 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:46.021147 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:46.124266 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:46.124231 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:46.293068 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:46.292988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:46.469115 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:46.469080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:47.634978 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:47.634940 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:47.730635 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:47.730600 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:47.838087 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:47.838046 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:48.055450 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:48.055420 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:48.453325 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:48.453243 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:48.558276 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:48.558233 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:49.503180 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:49.503148 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:52.878131 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:52.878080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:53.186940 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:53.186828 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:54.725584 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:54.725548 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:22:56.284548 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:22:56.284513 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:00.831383 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:00.831349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:00.932604 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:00.932569 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:01.119335 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:01.119245 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:01.239028 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:01.238992 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:02.240112 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:02.240077 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:02.315425 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:02.315386 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:02.426213 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:02.426177 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:02.910896 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:02.910859 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:03.009775 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:03.009745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:04.468751 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:04.468722 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:06.724772 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:06.724740 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:06.895484 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:06.895443 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:07.293863 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:07.293832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:07.396594 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:07.396556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:08.951648 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:08.951616 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:12.982013 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:12.981979 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:13.059686 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:13.059636 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:13.464222 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:13.464187 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:13.563659 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:13.563627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:13.663582 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:13.663555 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:15.098297 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:15.098265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:20.819102 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:20.819062 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:20.928491 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:20.928450 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:21.020829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:21.020795 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:21.118373 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:21.118288 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:21.504061 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:21.504027 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:25.803694 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:25.803658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:25.905239 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:25.905205 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:30.082643 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:30.082603 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:30.183481 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:30.183451 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:47.511546 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:47.511509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:53.387462 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:53.387431 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:53.462049 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:53.462020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:53.553999 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:53.553968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:23:53.653072 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:23:53.653000 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:09.565660 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:09.565629 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:15.179513 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:15.179478 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:15.252917 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:15.252892 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:15.339040 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:15.339012 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:15.482318 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:15.482237 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:25.968049 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:25.968014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:26.855980 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:26.855946 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:32.629206 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:32.629175 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:32.693652 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:32.693619 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:32.772977 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:32.772940 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:32.870922 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:32.870890 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:32.970961 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:32.970859 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.799643 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:33.799617 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.896014 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:33.895980 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:33.996121 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:33.996088 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:35.680784 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:35.680748 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:41.693128 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:41.693088 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:41.798377 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:41.798342 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:42.443010 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:42.442974 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:48.212236 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:48.212199 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:48.279000 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:48.278970 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:48.452796 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:48.452760 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:48.813539 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:48.813473 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:49.075841 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:49.075715 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:52.119456 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:52.119428 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:52.220870 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:52.220838 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:52.329866 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:52.329838 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:52.560808 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:52.560777 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:52.766190 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:52.766156 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:52.867368 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:52.867288 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:56.552199 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:56.552166 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:57.224775 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:57.224739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:57.324603 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:57.324575 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:24:57.698657 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:24:57.698604 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:03.624559 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:03.624513 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:03.738362 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:03.738327 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:03.890461 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:03.890338 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:04.229952 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:04.229846 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:04.329324 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:04.329293 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:10.099746 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:10.099634 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:10.200312 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:10.200279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:10.441283 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:10.441195 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:10.637202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:10.637171 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:10.758617 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:10.758583 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:10.859149 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:10.859105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:11.004561 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:11.004513 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:17.187658 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:17.187592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:17.318000 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:17.317966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:17.446591 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:17.446474 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:17.601932 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:17.601897 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:23.381643 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:23.381610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:23.461520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:23.461487 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:30.033690 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:30.033657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:30.373505 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:30.373431 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:30.726861 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:30.726780 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:33.400787 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:33.400755 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:33.501445 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:33.501409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:33.610045 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:33.610012 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:33.721452 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:33.721350 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:34.129124 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:34.129088 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:34.237177 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:34.237118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:37.835869 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:37.835813 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:56.146938 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:56.146868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:56.246657 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:56.246620 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:57.209525 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.209491 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z"] Jul 02 20:25:57.213067 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.213045 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.216592 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.216538 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-eb7f1a51\"/\"kube-root-ca.crt\"" Jul 02 20:25:57.216592 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.216584 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-eb7f1a51\"/\"e2e-lifecycle-model-eb7f1a51-kserve-self-signed-certs\"" Jul 02 20:25:57.216805 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.216584 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-eb7f1a51\"/\"openshift-service-ca.crt\"" Jul 02 20:25:57.216805 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.216633 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-eb7f1a51\"/\"default-dockercfg-v6f99\"" Jul 02 20:25:57.230113 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.230086 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z"] Jul 02 20:25:57.234382 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.234354 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:25:57.325496 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.325454 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-tmp-dir\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.325672 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.325534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-home\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.325672 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.325580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-dshm\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.325672 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.325635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-model-cache\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.325786 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.325680 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1287b38-f499-463c-bd1a-37967b5f8155-tls-certs\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.325786 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.325705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frpg9\" (UniqueName: \"kubernetes.io/projected/c1287b38-f499-463c-bd1a-37967b5f8155-kube-api-access-frpg9\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.426616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.426580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frpg9\" (UniqueName: \"kubernetes.io/projected/c1287b38-f499-463c-bd1a-37967b5f8155-kube-api-access-frpg9\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.426830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.426631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-tmp-dir\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.426830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.426681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-home\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.426830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.426719 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-dshm\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.426830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.426739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-model-cache\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.426830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.426764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1287b38-f499-463c-bd1a-37967b5f8155-tls-certs\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.427097 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.427080 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-home\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.427175 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.427150 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-tmp-dir\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.427251 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.427233 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-model-cache\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.429133 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.429115 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-dshm\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.429324 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.429309 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1287b38-f499-463c-bd1a-37967b5f8155-tls-certs\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.435003 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.434981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frpg9\" (UniqueName: \"kubernetes.io/projected/c1287b38-f499-463c-bd1a-37967b5f8155-kube-api-access-frpg9\") pod \"e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.528636 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.528596 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:25:57.669732 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:57.669706 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z"] Jul 02 20:25:57.671909 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:25:57.671862 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1287b38_f499_463c_bd1a_37967b5f8155.slice/crio-a3b8323fb64a1b53beac98b3aebafbd63ff479b584c5aa93cf75503c2277fb8c WatchSource:0}: Error finding container a3b8323fb64a1b53beac98b3aebafbd63ff479b584c5aa93cf75503c2277fb8c: Status 404 returned error can't find the container with id a3b8323fb64a1b53beac98b3aebafbd63ff479b584c5aa93cf75503c2277fb8c Jul 02 20:25:58.404732 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:58.404689 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" event={"ID":"c1287b38-f499-463c-bd1a-37967b5f8155","Type":"ContainerStarted","Data":"aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d"} Jul 02 20:25:58.404732 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:58.404735 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" event={"ID":"c1287b38-f499-463c-bd1a-37967b5f8155","Type":"ContainerStarted","Data":"a3b8323fb64a1b53beac98b3aebafbd63ff479b584c5aa93cf75503c2277fb8c"} Jul 02 20:25:58.423420 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:25:58.423365 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" podStartSLOduration=1.423350037 podStartE2EDuration="1.423350037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:25:58.421652934 +0000 UTC m=+1753.152095356" watchObservedRunningTime="2026-07-02 20:25:58.423350037 +0000 UTC m=+1753.153792443" Jul 02 20:26:07.529440 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:07.529404 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:26:07.529440 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:07.529450 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:26:07.541837 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:07.541809 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:26:08.465255 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:08.465228 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:26:20.574813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:20.574782 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.103141 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:21.103106 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.205526 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:21.205480 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:21.387761 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:21.387633 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:26.750799 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:26.750755 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:31.722749 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:31.722709 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z"] Jul 02 20:26:31.774177 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:31.774134 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:26:45.892191 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:45.892162 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:26:45.897355 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:45.897332 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:26:46.743830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:46.743785 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" podUID="c1287b38-f499-463c-bd1a-37967b5f8155" containerName="main" containerID="cri-o://aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d" gracePeriod=45 Jul 02 20:26:46.990215 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:46.990182 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:26:47.102607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102473 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frpg9\" (UniqueName: \"kubernetes.io/projected/c1287b38-f499-463c-bd1a-37967b5f8155-kube-api-access-frpg9\") pod \"c1287b38-f499-463c-bd1a-37967b5f8155\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " Jul 02 20:26:47.102607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102532 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1287b38-f499-463c-bd1a-37967b5f8155-tls-certs\") pod \"c1287b38-f499-463c-bd1a-37967b5f8155\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " Jul 02 20:26:47.102607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102576 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-home\") pod \"c1287b38-f499-463c-bd1a-37967b5f8155\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " Jul 02 20:26:47.102607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102598 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-tmp-dir\") pod \"c1287b38-f499-463c-bd1a-37967b5f8155\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " Jul 02 20:26:47.102607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102617 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-dshm\") pod \"c1287b38-f499-463c-bd1a-37967b5f8155\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " Jul 02 20:26:47.103129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102690 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-model-cache\") pod \"c1287b38-f499-463c-bd1a-37967b5f8155\" (UID: \"c1287b38-f499-463c-bd1a-37967b5f8155\") " Jul 02 20:26:47.103129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102855 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1287b38-f499-463c-bd1a-37967b5f8155" (UID: "c1287b38-f499-463c-bd1a-37967b5f8155"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:47.103129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.102896 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-home" (OuterVolumeSpecName: "home") pod "c1287b38-f499-463c-bd1a-37967b5f8155" (UID: "c1287b38-f499-463c-bd1a-37967b5f8155"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:47.103129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.103043 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-home\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:26:47.103129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.103084 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-tmp-dir\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:26:47.103129 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.103105 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1287b38-f499-463c-bd1a-37967b5f8155" (UID: "c1287b38-f499-463c-bd1a-37967b5f8155"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:47.104918 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.104866 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-dshm" (OuterVolumeSpecName: "dshm") pod "c1287b38-f499-463c-bd1a-37967b5f8155" (UID: "c1287b38-f499-463c-bd1a-37967b5f8155"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:26:47.105080 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.105053 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1287b38-f499-463c-bd1a-37967b5f8155-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1287b38-f499-463c-bd1a-37967b5f8155" (UID: "c1287b38-f499-463c-bd1a-37967b5f8155"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:26:47.105139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.105115 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1287b38-f499-463c-bd1a-37967b5f8155-kube-api-access-frpg9" (OuterVolumeSpecName: "kube-api-access-frpg9") pod "c1287b38-f499-463c-bd1a-37967b5f8155" (UID: "c1287b38-f499-463c-bd1a-37967b5f8155"). InnerVolumeSpecName "kube-api-access-frpg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:26:47.203597 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.203559 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-model-cache\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:26:47.203597 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.203592 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frpg9\" (UniqueName: \"kubernetes.io/projected/c1287b38-f499-463c-bd1a-37967b5f8155-kube-api-access-frpg9\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:26:47.203597 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.203604 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1287b38-f499-463c-bd1a-37967b5f8155-tls-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:26:47.203829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.203614 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1287b38-f499-463c-bd1a-37967b5f8155-dshm\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:26:47.656077 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.656043 2555 generic.go:356] "Generic (PLEG): container finished" podID="c1287b38-f499-463c-bd1a-37967b5f8155" containerID="aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d" exitCode=0 Jul 02 20:26:47.656253 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.656085 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" Jul 02 20:26:47.656253 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.656130 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" event={"ID":"c1287b38-f499-463c-bd1a-37967b5f8155","Type":"ContainerDied","Data":"aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d"} Jul 02 20:26:47.656253 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.656183 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z" event={"ID":"c1287b38-f499-463c-bd1a-37967b5f8155","Type":"ContainerDied","Data":"a3b8323fb64a1b53beac98b3aebafbd63ff479b584c5aa93cf75503c2277fb8c"} Jul 02 20:26:47.656253 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.656200 2555 scope.go:117] "RemoveContainer" containerID="aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d" Jul 02 20:26:47.665320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.665303 2555 scope.go:117] "RemoveContainer" containerID="aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d" Jul 02 20:26:47.665571 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:26:47.665550 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d\": container with ID starting with aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d not found: ID does not exist" containerID="aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d" Jul 02 20:26:47.665643 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.665584 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d"} err="failed to get container status \"aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d\": rpc error: code = NotFound desc = could not find container \"aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d\": container with ID starting with aedd9d19b4d037a12f40c962d5109df07ccfdc380436961523b56a631e390d7d not found: ID does not exist" Jul 02 20:26:47.678352 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.678329 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z"] Jul 02 20:26:47.682254 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.682233 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-eb7f1a51/e2e-lifecycle-model-eb7f1a51-kserve-569ffb4f6c-hbb9z"] Jul 02 20:26:47.873636 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:26:47.873595 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1287b38-f499-463c-bd1a-37967b5f8155" path="/var/lib/kubelet/pods/c1287b38-f499-463c-bd1a-37967b5f8155/volumes" Jul 02 20:27:08.524479 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:08.524445 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:08.709734 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:08.709701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:14.576347 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:14.576316 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:37.659333 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:37.659302 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:37.757094 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:37.757057 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:37.929506 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:37.929412 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:38.152441 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:38.152414 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:39.218097 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:39.218063 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:39.314654 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:39.314622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:39.414153 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:39.414112 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:40.143351 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:40.143298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:40.247737 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:40.247694 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:40.348335 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:40.348305 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:41.665022 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:41.664985 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:47.525361 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:47.525312 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:47.590431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:47.590368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:48.185728 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:48.185692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:53.962200 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:53.962165 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:54.075797 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:54.075759 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:27:54.158614 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:27:54.158579 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:04.673821 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:04.673782 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:05.931679 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:05.931598 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:26.016824 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:26.016745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:30.929292 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:30.929239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:31.825430 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:31.825396 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:31.924499 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:31.924468 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:32.180011 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:32.179923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:32.483086 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:32.483007 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:32.677411 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:32.677378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:35.297868 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:35.297829 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:35.390706 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:35.390671 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:35.467074 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:35.467043 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:35.807932 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:35.807902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:35.913298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:35.913255 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:36.008327 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:36.008279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:39.751821 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:39.751785 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:40.098779 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.098689 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:40.374521 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.374434 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk"] Jul 02 20:28:40.374931 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.374913 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1287b38-f499-463c-bd1a-37967b5f8155" containerName="main" Jul 02 20:28:40.374931 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.374932 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1287b38-f499-463c-bd1a-37967b5f8155" containerName="main" Jul 02 20:28:40.375078 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.375037 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1287b38-f499-463c-bd1a-37967b5f8155" containerName="main" Jul 02 20:28:40.378080 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.378059 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.380972 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.380955 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 20:28:40.380972 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.380970 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fe96cd-openshift-default-dockercfg-w7hkl\"" Jul 02 20:28:40.388596 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.388570 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk"] Jul 02 20:28:40.403193 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.403168 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:40.470596 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76gs\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-kube-api-access-w76gs\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470596 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-socket\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470814 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-podinfo\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470814 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-certs\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470814 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470752 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-envoy\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470814 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-data\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470987 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-credential-socket\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470987 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/432bf9c5-f208-4dd2-8220-153631a0a8c3-istiod-ca-cert\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.470987 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.470954 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-token\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572134 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572101 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-certs\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572144 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-envoy\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-data\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572199 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-credential-socket\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/432bf9c5-f208-4dd2-8220-153631a0a8c3-istiod-ca-cert\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-token\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572277 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76gs\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-kube-api-access-w76gs\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572311 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-socket\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572698 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-podinfo\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572776 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572694 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-data\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572776 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572770 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-certs\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.572897 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.572797 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-socket\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.573044 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.573022 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-credential-socket\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.573121 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.573069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/432bf9c5-f208-4dd2-8220-153631a0a8c3-istiod-ca-cert\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.574685 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.574666 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-envoy\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.575031 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.575012 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-podinfo\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.585802 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.585748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-token\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.586215 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.586194 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76gs\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-kube-api-access-w76gs\") pod \"e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.631609 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.631530 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:40.689786 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.689745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:40.830841 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.830807 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk"] Jul 02 20:28:40.835403 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:40.835378 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:28:41.214699 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:41.214657 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" event={"ID":"432bf9c5-f208-4dd2-8220-153631a0a8c3","Type":"ContainerStarted","Data":"0414bb4119d59dcfd968ee87eb0935bda590d249a87ab43f3487e1234fcf4bb9"} Jul 02 20:28:44.692206 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:44.692158 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:28:44.692475 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:44.692262 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:28:44.692475 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:44.692304 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:28:45.238893 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:45.238851 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" event={"ID":"432bf9c5-f208-4dd2-8220-153631a0a8c3","Type":"ContainerStarted","Data":"53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0"} Jul 02 20:28:45.261652 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:45.261596 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" podStartSLOduration=1.405431647 podStartE2EDuration="5.261580863s" totalImagesPullingTime="3.856149216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:28:45.260137568 +0000 UTC m=+1919.990579975" watchObservedRunningTime="2026-07-02 20:28:45.261580863 +0000 UTC m=+1919.992023268" Jul 02 20:28:45.690433 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:45.690393 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:45.695657 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:45.695629 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:46.243533 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:46.243499 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:46.244569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:46.244552 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:28:47.349803 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:47.349772 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:47.456298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:47.456256 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:47.555122 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:47.555072 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:47.772843 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:47.772809 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:47.998773 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:47.998745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:48.102953 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:48.102842 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:51.853811 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:51.853758 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:57.453690 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:57.453650 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:57.557862 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:57.557821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:28:59.320048 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:59.320016 2555 generic.go:356] "Generic (PLEG): container finished" podID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerID="53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0" exitCode=0 Jul 02 20:28:59.320446 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:59.320084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" event={"ID":"432bf9c5-f208-4dd2-8220-153631a0a8c3","Type":"ContainerDied","Data":"53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0"} Jul 02 20:28:59.320515 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:59.320498 2555 scope.go:117] "RemoveContainer" containerID="53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0" Jul 02 20:28:59.321581 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:59.321553 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:28:59.321639 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:59.321621 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:28:59.321674 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:28:59.321655 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:29:00.326942 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:00.326871 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" event={"ID":"432bf9c5-f208-4dd2-8220-153631a0a8c3","Type":"ContainerStarted","Data":"4ea3bcc8e4ba896f96f9f9e46774a5cfde64feceb120b0c22fca0c477062a35c"} Jul 02 20:29:00.691499 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:00.691400 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:29:00.691817 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:00.691792 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 20:29:00.692021 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:00.691985 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 20:29:01.243782 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:01.243746 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:29:01.691408 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:01.691312 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 20:29:01.692009 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:01.691973 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 20:29:02.691258 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:02.691217 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 20:29:02.691486 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:02.691315 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 20:29:03.690704 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:03.690659 2555 patch_prober.go:28] interesting pod/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 20:29:03.690962 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:03.690732 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 20:29:04.693748 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:04.693719 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:29:04.694688 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:04.694666 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:29:05.406733 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.406700 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv"] Jul 02 20:29:05.414529 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.414504 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.417726 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.417535 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-55ba03\"/\"test-model-55ba03-kserve-self-signed-certs\"" Jul 02 20:29:05.417726 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.417572 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-55ba03\"/\"openshift-service-ca.crt\"" Jul 02 20:29:05.417726 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.417536 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-55ba03\"/\"kube-root-ca.crt\"" Jul 02 20:29:05.418011 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.417759 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-55ba03\"/\"default-dockercfg-nhjg2\"" Jul 02 20:29:05.420478 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.420453 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv"] Jul 02 20:29:05.432204 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.432174 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:29:05.517691 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.517662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-model-cache\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.517864 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.517701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/666bedf6-ff51-47d0-a803-857e4cb32fdb-tls-certs\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.517864 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.517764 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-dshm\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.517964 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.517903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-home\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.517964 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.517932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-tmp-dir\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.517964 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.517958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44j5b\" (UniqueName: \"kubernetes.io/projected/666bedf6-ff51-47d0-a803-857e4cb32fdb-kube-api-access-44j5b\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.618492 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.618460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/666bedf6-ff51-47d0-a803-857e4cb32fdb-tls-certs\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.618676 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.618503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-dshm\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.618676 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.618579 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-home\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.618676 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.618600 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-tmp-dir\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.618676 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.618628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44j5b\" (UniqueName: \"kubernetes.io/projected/666bedf6-ff51-47d0-a803-857e4cb32fdb-kube-api-access-44j5b\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.618676 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.618672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-model-cache\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.619102 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.619078 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-model-cache\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.619102 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.619098 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-home\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.619230 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.619128 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-tmp-dir\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.621358 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.621330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-dshm\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.621741 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.621720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/666bedf6-ff51-47d0-a803-857e4cb32fdb-tls-certs\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.627930 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.627905 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44j5b\" (UniqueName: \"kubernetes.io/projected/666bedf6-ff51-47d0-a803-857e4cb32fdb-kube-api-access-44j5b\") pod \"test-model-55ba03-kserve-6f7f5fd449-fm7dv\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.725784 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.725676 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:05.860307 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:05.860281 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv"] Jul 02 20:29:05.862507 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:29:05.862478 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod666bedf6_ff51_47d0_a803_857e4cb32fdb.slice/crio-940ca53c680d969a6424d7f92a8f120ec1d6f43a6a126c8b7b7ca0911a666f6d WatchSource:0}: Error finding container 940ca53c680d969a6424d7f92a8f120ec1d6f43a6a126c8b7b7ca0911a666f6d: Status 404 returned error can't find the container with id 940ca53c680d969a6424d7f92a8f120ec1d6f43a6a126c8b7b7ca0911a666f6d Jul 02 20:29:06.356576 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:06.356535 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" event={"ID":"666bedf6-ff51-47d0-a803-857e4cb32fdb","Type":"ContainerStarted","Data":"98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997"} Jul 02 20:29:06.356576 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:06.356581 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" event={"ID":"666bedf6-ff51-47d0-a803-857e4cb32fdb","Type":"ContainerStarted","Data":"940ca53c680d969a6424d7f92a8f120ec1d6f43a6a126c8b7b7ca0911a666f6d"} Jul 02 20:29:06.375718 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:06.375665 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" podStartSLOduration=1.37564815 podStartE2EDuration="1.37564815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:29:06.373650464 +0000 UTC m=+1941.104092870" watchObservedRunningTime="2026-07-02 20:29:06.37564815 +0000 UTC m=+1941.106090555" Jul 02 20:29:08.711712 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:08.711677 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:29:08.812868 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:08.812807 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:29:15.726502 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:15.726464 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:15.726908 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:15.726655 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:15.739123 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:15.739097 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:16.416124 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:16.416094 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:29:47.830814 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:29:47.830765 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:00.135989 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.135953 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-5n6qv"] Jul 02 20:30:00.140202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.140175 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt"] Jul 02 20:30:00.140365 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.140309 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:00.143617 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.143595 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cwtmg\"" Jul 02 20:30:00.144057 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.144038 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd"] Jul 02 20:30:00.144165 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.144138 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:00.147496 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.147474 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:00.149345 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.149322 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-5n6qv"] Jul 02 20:30:00.152368 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.152339 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd"] Jul 02 20:30:00.155497 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.155469 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt"] Jul 02 20:30:00.251175 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.251141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85d9q\" (UniqueName: \"kubernetes.io/projected/100e8257-9bc9-4eba-b50b-a96cb9e18a49-kube-api-access-85d9q\") pod \"maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd\" (UID: \"100e8257-9bc9-4eba-b50b-a96cb9e18a49\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:00.251175 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.251179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9jk\" (UniqueName: \"kubernetes.io/projected/fa943bb3-a256-4710-ac53-85079b30f28a-kube-api-access-tg9jk\") pod \"maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt\" (UID: \"fa943bb3-a256-4710-ac53-85079b30f28a\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:00.251449 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.251280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk86k\" (UniqueName: \"kubernetes.io/projected/9037e1b5-f500-4822-bda0-2b5779466cd2-kube-api-access-tk86k\") pod \"maas-api-key-cleanup-29717070-5n6qv\" (UID: \"9037e1b5-f500-4822-bda0-2b5779466cd2\") " pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:00.352791 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.352753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85d9q\" (UniqueName: \"kubernetes.io/projected/100e8257-9bc9-4eba-b50b-a96cb9e18a49-kube-api-access-85d9q\") pod \"maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd\" (UID: \"100e8257-9bc9-4eba-b50b-a96cb9e18a49\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:00.352974 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.352809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9jk\" (UniqueName: \"kubernetes.io/projected/fa943bb3-a256-4710-ac53-85079b30f28a-kube-api-access-tg9jk\") pod \"maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt\" (UID: \"fa943bb3-a256-4710-ac53-85079b30f28a\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:00.352974 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.352938 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk86k\" (UniqueName: \"kubernetes.io/projected/9037e1b5-f500-4822-bda0-2b5779466cd2-kube-api-access-tk86k\") pod \"maas-api-key-cleanup-29717070-5n6qv\" (UID: \"9037e1b5-f500-4822-bda0-2b5779466cd2\") " pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:00.361690 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.361643 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk86k\" (UniqueName: \"kubernetes.io/projected/9037e1b5-f500-4822-bda0-2b5779466cd2-kube-api-access-tk86k\") pod \"maas-api-key-cleanup-29717070-5n6qv\" (UID: \"9037e1b5-f500-4822-bda0-2b5779466cd2\") " pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:00.361944 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.361915 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85d9q\" (UniqueName: \"kubernetes.io/projected/100e8257-9bc9-4eba-b50b-a96cb9e18a49-kube-api-access-85d9q\") pod \"maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd\" (UID: \"100e8257-9bc9-4eba-b50b-a96cb9e18a49\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:00.362045 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.361972 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9jk\" (UniqueName: \"kubernetes.io/projected/fa943bb3-a256-4710-ac53-85079b30f28a-kube-api-access-tg9jk\") pod \"maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt\" (UID: \"fa943bb3-a256-4710-ac53-85079b30f28a\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:00.454302 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.454215 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:00.464617 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.464591 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:00.470603 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.470576 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:00.821752 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.821723 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717070-5n6qv"] Jul 02 20:30:00.823460 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:30:00.823428 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9037e1b5_f500_4822_bda0_2b5779466cd2.slice/crio-0bbb3eb4786a32228172177ed3fba0d4b30896f7a74290b16eaef4c2ddc6ba56 WatchSource:0}: Error finding container 0bbb3eb4786a32228172177ed3fba0d4b30896f7a74290b16eaef4c2ddc6ba56: Status 404 returned error can't find the container with id 0bbb3eb4786a32228172177ed3fba0d4b30896f7a74290b16eaef4c2ddc6ba56 Jul 02 20:30:00.847867 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.847834 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt"] Jul 02 20:30:00.855288 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:30:00.855263 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa943bb3_a256_4710_ac53_85079b30f28a.slice/crio-37115f8f676ed0f6b42b16e49616d62e4fd477252fa046962fb1175812f9b42c WatchSource:0}: Error finding container 37115f8f676ed0f6b42b16e49616d62e4fd477252fa046962fb1175812f9b42c: Status 404 returned error can't find the container with id 37115f8f676ed0f6b42b16e49616d62e4fd477252fa046962fb1175812f9b42c Jul 02 20:30:00.858099 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:00.858073 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd"] Jul 02 20:30:00.861641 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:30:00.861616 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100e8257_9bc9_4eba_b50b_a96cb9e18a49.slice/crio-001f0a4571140ea9565a661966403ab78d1554bfbbecba1d7da83db63113a6ef WatchSource:0}: Error finding container 001f0a4571140ea9565a661966403ab78d1554bfbbecba1d7da83db63113a6ef: Status 404 returned error can't find the container with id 001f0a4571140ea9565a661966403ab78d1554bfbbecba1d7da83db63113a6ef Jul 02 20:30:01.631261 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.631221 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" event={"ID":"fa943bb3-a256-4710-ac53-85079b30f28a","Type":"ContainerStarted","Data":"e24c3c2ba32423ee450f7f16872e1af8e133deb8bae3eb2cbf4bc828cb7d72fe"} Jul 02 20:30:01.631714 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.631293 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" event={"ID":"fa943bb3-a256-4710-ac53-85079b30f28a","Type":"ContainerStarted","Data":"37115f8f676ed0f6b42b16e49616d62e4fd477252fa046962fb1175812f9b42c"} Jul 02 20:30:01.632742 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.632710 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" event={"ID":"9037e1b5-f500-4822-bda0-2b5779466cd2","Type":"ContainerStarted","Data":"0ed6b4f920354c7a03a9036af0f01db6b9ecaa7668a5f441ec35445f814479fa"} Jul 02 20:30:01.632911 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.632759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" event={"ID":"9037e1b5-f500-4822-bda0-2b5779466cd2","Type":"ContainerStarted","Data":"0bbb3eb4786a32228172177ed3fba0d4b30896f7a74290b16eaef4c2ddc6ba56"} Jul 02 20:30:01.634204 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.634178 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" event={"ID":"100e8257-9bc9-4eba-b50b-a96cb9e18a49","Type":"ContainerStarted","Data":"4d59c16e38466aef53099fbeebe2640f179d6b65657095fa3293fe23e24bc9f2"} Jul 02 20:30:01.634316 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.634227 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" event={"ID":"100e8257-9bc9-4eba-b50b-a96cb9e18a49","Type":"ContainerStarted","Data":"001f0a4571140ea9565a661966403ab78d1554bfbbecba1d7da83db63113a6ef"} Jul 02 20:30:01.653229 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.653173 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" podStartSLOduration=1.653153499 podStartE2EDuration="1.653153499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:01.649244303 +0000 UTC m=+1996.379686710" watchObservedRunningTime="2026-07-02 20:30:01.653153499 +0000 UTC m=+1996.383595906" Jul 02 20:30:01.667278 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.667234 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" podStartSLOduration=1.667217275 podStartE2EDuration="1.667217275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:01.665476511 +0000 UTC m=+1996.395918918" watchObservedRunningTime="2026-07-02 20:30:01.667217275 +0000 UTC m=+1996.397659681" Jul 02 20:30:01.682512 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.682462 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" podStartSLOduration=1.682446798 podStartE2EDuration="1.682446798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:01.680790363 +0000 UTC m=+1996.411232771" watchObservedRunningTime="2026-07-02 20:30:01.682446798 +0000 UTC m=+1996.412889245" Jul 02 20:30:01.686503 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:01.686476 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:02.640818 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:02.640783 2555 generic.go:356] "Generic (PLEG): container finished" podID="fa943bb3-a256-4710-ac53-85079b30f28a" containerID="e24c3c2ba32423ee450f7f16872e1af8e133deb8bae3eb2cbf4bc828cb7d72fe" exitCode=0 Jul 02 20:30:02.641299 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:02.640892 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" event={"ID":"fa943bb3-a256-4710-ac53-85079b30f28a","Type":"ContainerDied","Data":"e24c3c2ba32423ee450f7f16872e1af8e133deb8bae3eb2cbf4bc828cb7d72fe"} Jul 02 20:30:02.642324 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:02.642301 2555 generic.go:356] "Generic (PLEG): container finished" podID="9037e1b5-f500-4822-bda0-2b5779466cd2" containerID="0ed6b4f920354c7a03a9036af0f01db6b9ecaa7668a5f441ec35445f814479fa" exitCode=0 Jul 02 20:30:02.642439 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:02.642376 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" event={"ID":"9037e1b5-f500-4822-bda0-2b5779466cd2","Type":"ContainerDied","Data":"0ed6b4f920354c7a03a9036af0f01db6b9ecaa7668a5f441ec35445f814479fa"} Jul 02 20:30:02.643654 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:02.643632 2555 generic.go:356] "Generic (PLEG): container finished" podID="100e8257-9bc9-4eba-b50b-a96cb9e18a49" containerID="4d59c16e38466aef53099fbeebe2640f179d6b65657095fa3293fe23e24bc9f2" exitCode=0 Jul 02 20:30:02.643733 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:02.643699 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" event={"ID":"100e8257-9bc9-4eba-b50b-a96cb9e18a49","Type":"ContainerDied","Data":"4d59c16e38466aef53099fbeebe2640f179d6b65657095fa3293fe23e24bc9f2"} Jul 02 20:30:03.800812 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.800782 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:03.855835 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.855812 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:03.859006 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.858988 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:03.990964 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.990845 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk86k\" (UniqueName: \"kubernetes.io/projected/9037e1b5-f500-4822-bda0-2b5779466cd2-kube-api-access-tk86k\") pod \"9037e1b5-f500-4822-bda0-2b5779466cd2\" (UID: \"9037e1b5-f500-4822-bda0-2b5779466cd2\") " Jul 02 20:30:03.990964 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.990936 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85d9q\" (UniqueName: \"kubernetes.io/projected/100e8257-9bc9-4eba-b50b-a96cb9e18a49-kube-api-access-85d9q\") pod \"100e8257-9bc9-4eba-b50b-a96cb9e18a49\" (UID: \"100e8257-9bc9-4eba-b50b-a96cb9e18a49\") " Jul 02 20:30:03.991211 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.990987 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg9jk\" (UniqueName: \"kubernetes.io/projected/fa943bb3-a256-4710-ac53-85079b30f28a-kube-api-access-tg9jk\") pod \"fa943bb3-a256-4710-ac53-85079b30f28a\" (UID: \"fa943bb3-a256-4710-ac53-85079b30f28a\") " Jul 02 20:30:03.993256 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.993218 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9037e1b5-f500-4822-bda0-2b5779466cd2-kube-api-access-tk86k" (OuterVolumeSpecName: "kube-api-access-tk86k") pod "9037e1b5-f500-4822-bda0-2b5779466cd2" (UID: "9037e1b5-f500-4822-bda0-2b5779466cd2"). InnerVolumeSpecName "kube-api-access-tk86k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:03.993443 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.993418 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa943bb3-a256-4710-ac53-85079b30f28a-kube-api-access-tg9jk" (OuterVolumeSpecName: "kube-api-access-tg9jk") pod "fa943bb3-a256-4710-ac53-85079b30f28a" (UID: "fa943bb3-a256-4710-ac53-85079b30f28a"). InnerVolumeSpecName "kube-api-access-tg9jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:03.993533 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:03.993517 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100e8257-9bc9-4eba-b50b-a96cb9e18a49-kube-api-access-85d9q" (OuterVolumeSpecName: "kube-api-access-85d9q") pod "100e8257-9bc9-4eba-b50b-a96cb9e18a49" (UID: "100e8257-9bc9-4eba-b50b-a96cb9e18a49"). InnerVolumeSpecName "kube-api-access-85d9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:04.092113 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.092073 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk86k\" (UniqueName: \"kubernetes.io/projected/9037e1b5-f500-4822-bda0-2b5779466cd2-kube-api-access-tk86k\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:04.092113 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.092104 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85d9q\" (UniqueName: \"kubernetes.io/projected/100e8257-9bc9-4eba-b50b-a96cb9e18a49-kube-api-access-85d9q\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:04.092113 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.092114 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg9jk\" (UniqueName: \"kubernetes.io/projected/fa943bb3-a256-4710-ac53-85079b30f28a-kube-api-access-tg9jk\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:04.654989 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.654958 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" Jul 02 20:30:04.655203 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.654999 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt" event={"ID":"fa943bb3-a256-4710-ac53-85079b30f28a","Type":"ContainerDied","Data":"37115f8f676ed0f6b42b16e49616d62e4fd477252fa046962fb1175812f9b42c"} Jul 02 20:30:04.655203 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.655053 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37115f8f676ed0f6b42b16e49616d62e4fd477252fa046962fb1175812f9b42c" Jul 02 20:30:04.656385 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.656365 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" Jul 02 20:30:04.656469 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.656365 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717070-5n6qv" event={"ID":"9037e1b5-f500-4822-bda0-2b5779466cd2","Type":"ContainerDied","Data":"0bbb3eb4786a32228172177ed3fba0d4b30896f7a74290b16eaef4c2ddc6ba56"} Jul 02 20:30:04.656520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.656480 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bbb3eb4786a32228172177ed3fba0d4b30896f7a74290b16eaef4c2ddc6ba56" Jul 02 20:30:04.657562 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.657543 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" Jul 02 20:30:04.657650 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.657548 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd" event={"ID":"100e8257-9bc9-4eba-b50b-a96cb9e18a49","Type":"ContainerDied","Data":"001f0a4571140ea9565a661966403ab78d1554bfbbecba1d7da83db63113a6ef"} Jul 02 20:30:04.657650 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:04.657644 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="001f0a4571140ea9565a661966403ab78d1554bfbbecba1d7da83db63113a6ef" Jul 02 20:30:05.909739 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:05.909707 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv"] Jul 02 20:30:05.921045 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:05.921017 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.170178 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.170146 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.270760 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.270726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.474845 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.474760 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.575024 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.574993 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.676147 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.676116 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.753801 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.753762 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:07.754761 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.754738 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd"] Jul 02 20:30:07.756759 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.756739 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-55ba03-29717070-vmnnd"] Jul 02 20:30:07.872394 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:07.872363 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="100e8257-9bc9-4eba-b50b-a96cb9e18a49" path="/var/lib/kubelet/pods/100e8257-9bc9-4eba-b50b-a96cb9e18a49/volumes" Jul 02 20:30:12.554539 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:12.554506 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:20.931093 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:20.931032 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" podUID="666bedf6-ff51-47d0-a803-857e4cb32fdb" containerName="main" containerID="cri-o://98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997" gracePeriod=45 Jul 02 20:30:21.181420 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.181360 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:30:21.260923 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.260866 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-tmp-dir\") pod \"666bedf6-ff51-47d0-a803-857e4cb32fdb\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " Jul 02 20:30:21.261094 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.260939 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44j5b\" (UniqueName: \"kubernetes.io/projected/666bedf6-ff51-47d0-a803-857e4cb32fdb-kube-api-access-44j5b\") pod \"666bedf6-ff51-47d0-a803-857e4cb32fdb\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " Jul 02 20:30:21.261094 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261013 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/666bedf6-ff51-47d0-a803-857e4cb32fdb-tls-certs\") pod \"666bedf6-ff51-47d0-a803-857e4cb32fdb\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " Jul 02 20:30:21.261094 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261032 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-model-cache\") pod \"666bedf6-ff51-47d0-a803-857e4cb32fdb\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " Jul 02 20:30:21.261094 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261070 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-home\") pod \"666bedf6-ff51-47d0-a803-857e4cb32fdb\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " Jul 02 20:30:21.261094 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261093 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-dshm\") pod \"666bedf6-ff51-47d0-a803-857e4cb32fdb\" (UID: \"666bedf6-ff51-47d0-a803-857e4cb32fdb\") " Jul 02 20:30:21.261374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261102 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "666bedf6-ff51-47d0-a803-857e4cb32fdb" (UID: "666bedf6-ff51-47d0-a803-857e4cb32fdb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:30:21.261374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261343 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-model-cache" (OuterVolumeSpecName: "model-cache") pod "666bedf6-ff51-47d0-a803-857e4cb32fdb" (UID: "666bedf6-ff51-47d0-a803-857e4cb32fdb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:30:21.261374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261354 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-home" (OuterVolumeSpecName: "home") pod "666bedf6-ff51-47d0-a803-857e4cb32fdb" (UID: "666bedf6-ff51-47d0-a803-857e4cb32fdb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:30:21.261374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.261355 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-tmp-dir\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:21.263120 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.263092 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/666bedf6-ff51-47d0-a803-857e4cb32fdb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "666bedf6-ff51-47d0-a803-857e4cb32fdb" (UID: "666bedf6-ff51-47d0-a803-857e4cb32fdb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:30:21.263243 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.263217 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/666bedf6-ff51-47d0-a803-857e4cb32fdb-kube-api-access-44j5b" (OuterVolumeSpecName: "kube-api-access-44j5b") pod "666bedf6-ff51-47d0-a803-857e4cb32fdb" (UID: "666bedf6-ff51-47d0-a803-857e4cb32fdb"). InnerVolumeSpecName "kube-api-access-44j5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:30:21.263311 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.263257 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-dshm" (OuterVolumeSpecName: "dshm") pod "666bedf6-ff51-47d0-a803-857e4cb32fdb" (UID: "666bedf6-ff51-47d0-a803-857e4cb32fdb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:30:21.362245 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.362200 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/666bedf6-ff51-47d0-a803-857e4cb32fdb-tls-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:21.362245 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.362231 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-model-cache\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:21.362245 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.362253 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-home\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:21.362483 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.362263 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/666bedf6-ff51-47d0-a803-857e4cb32fdb-dshm\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:21.362483 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.362275 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44j5b\" (UniqueName: \"kubernetes.io/projected/666bedf6-ff51-47d0-a803-857e4cb32fdb-kube-api-access-44j5b\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:30:21.745165 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.745129 2555 generic.go:356] "Generic (PLEG): container finished" podID="666bedf6-ff51-47d0-a803-857e4cb32fdb" containerID="98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997" exitCode=0 Jul 02 20:30:21.745364 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.745179 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" Jul 02 20:30:21.745364 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.745243 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" event={"ID":"666bedf6-ff51-47d0-a803-857e4cb32fdb","Type":"ContainerDied","Data":"98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997"} Jul 02 20:30:21.745364 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.745287 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv" event={"ID":"666bedf6-ff51-47d0-a803-857e4cb32fdb","Type":"ContainerDied","Data":"940ca53c680d969a6424d7f92a8f120ec1d6f43a6a126c8b7b7ca0911a666f6d"} Jul 02 20:30:21.745364 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.745308 2555 scope.go:117] "RemoveContainer" containerID="98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997" Jul 02 20:30:21.763306 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.761709 2555 scope.go:117] "RemoveContainer" containerID="98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997" Jul 02 20:30:21.763667 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:30:21.763638 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997\": container with ID starting with 98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997 not found: ID does not exist" containerID="98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997" Jul 02 20:30:21.763771 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.763674 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997"} err="failed to get container status \"98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997\": rpc error: code = NotFound desc = could not find container \"98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997\": container with ID starting with 98976cea40f552a4c5554fa91c8480f0b62d4754ab4cb089e2965ba1dda29997 not found: ID does not exist" Jul 02 20:30:21.769934 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.769910 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv"] Jul 02 20:30:21.773934 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.773900 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-55ba03/test-model-55ba03-kserve-6f7f5fd449-fm7dv"] Jul 02 20:30:21.872922 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:21.872870 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="666bedf6-ff51-47d0-a803-857e4cb32fdb" path="/var/lib/kubelet/pods/666bedf6-ff51-47d0-a803-857e4cb32fdb/volumes" Jul 02 20:30:49.458468 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:49.458431 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:49.801726 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:49.801692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:50.047667 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:50.047624 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:50.296931 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:50.296896 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:50.674045 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:50.673950 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:50.854578 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:50.854552 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:50.957175 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:50.957095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:51.090199 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:51.090163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:51.096942 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:51.096914 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt"] Jul 02 20:30:51.100961 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:51.100926 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-b-fe96cd-29717070-v9zmt"] Jul 02 20:30:51.873490 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:51.873456 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa943bb3-a256-4710-ac53-85079b30f28a" path="/var/lib/kubelet/pods/fa943bb3-a256-4710-ac53-85079b30f28a/volumes" Jul 02 20:30:56.413023 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.412990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:56.577729 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.577696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:56.701841 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.701758 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk"] Jul 02 20:30:56.702054 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.702027 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" containerID="cri-o://4ea3bcc8e4ba896f96f9f9e46774a5cfde64feceb120b0c22fca0c477062a35c" gracePeriod=30 Jul 02 20:30:56.717417 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.717387 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:56.843081 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.843052 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:56.944259 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:56.944229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:57.043598 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.043565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:57.343371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.343282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:57.723779 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.723700 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679"] Jul 02 20:30:57.724294 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724276 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9037e1b5-f500-4822-bda0-2b5779466cd2" containerName="cleanup" Jul 02 20:30:57.724294 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724295 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="9037e1b5-f500-4822-bda0-2b5779466cd2" containerName="cleanup" Jul 02 20:30:57.724402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724306 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100e8257-9bc9-4eba-b50b-a96cb9e18a49" containerName="cleanup" Jul 02 20:30:57.724402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724312 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="100e8257-9bc9-4eba-b50b-a96cb9e18a49" containerName="cleanup" Jul 02 20:30:57.724402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724321 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666bedf6-ff51-47d0-a803-857e4cb32fdb" containerName="main" Jul 02 20:30:57.724402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724327 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="666bedf6-ff51-47d0-a803-857e4cb32fdb" containerName="main" Jul 02 20:30:57.724402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724343 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa943bb3-a256-4710-ac53-85079b30f28a" containerName="cleanup" Jul 02 20:30:57.724402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724348 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa943bb3-a256-4710-ac53-85079b30f28a" containerName="cleanup" Jul 02 20:30:57.724585 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724413 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="666bedf6-ff51-47d0-a803-857e4cb32fdb" containerName="main" Jul 02 20:30:57.724585 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724425 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="9037e1b5-f500-4822-bda0-2b5779466cd2" containerName="cleanup" Jul 02 20:30:57.724585 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724430 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa943bb3-a256-4710-ac53-85079b30f28a" containerName="cleanup" Jul 02 20:30:57.724585 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.724438 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="100e8257-9bc9-4eba-b50b-a96cb9e18a49" containerName="cleanup" Jul 02 20:30:57.727715 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.727698 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.730423 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.730405 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9f6297-openshift-default-dockercfg-4dklr\"" Jul 02 20:30:57.739597 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.739572 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679"] Jul 02 20:30:57.752745 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.752713 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:57.825561 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-socket\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.825762 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-data\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.825762 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-envoy\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.825853 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-istio-token\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.825853 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825796 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/016200fe-f769-483d-97df-98b52cd699ed-istiod-ca-cert\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.825853 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-certs\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.826013 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/016200fe-f769-483d-97df-98b52cd699ed-istio-podinfo\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.826013 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.825946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlphz\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-kube-api-access-jlphz\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.826112 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.826011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-credential-socket\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.926934 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.926903 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-socket\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.926948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-data\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.926965 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-envoy\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-istio-token\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927034 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/016200fe-f769-483d-97df-98b52cd699ed-istiod-ca-cert\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-certs\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927092 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/016200fe-f769-483d-97df-98b52cd699ed-istio-podinfo\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927117 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlphz\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-kube-api-access-jlphz\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927508 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927146 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-credential-socket\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927508 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927351 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-socket\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927508 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927435 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-certs\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927508 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927453 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-data\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927663 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927520 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-credential-socket\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.927754 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.927735 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/016200fe-f769-483d-97df-98b52cd699ed-istiod-ca-cert\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.929469 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.929449 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-envoy\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.929554 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.929500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/016200fe-f769-483d-97df-98b52cd699ed-istio-podinfo\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.936030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.936006 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-istio-token\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:57.936206 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:57.936186 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlphz\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-kube-api-access-jlphz\") pod \"e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:58.007321 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.007284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:30:58.038802 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.038772 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:58.180844 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.180819 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679"] Jul 02 20:30:58.183297 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:30:58.183266 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016200fe_f769_483d_97df_98b52cd699ed.slice/crio-558209a539392d1c8e9174a7be5a61f56ff84dbb015e3e9a65bc084616123d77 WatchSource:0}: Error finding container 558209a539392d1c8e9174a7be5a61f56ff84dbb015e3e9a65bc084616123d77: Status 404 returned error can't find the container with id 558209a539392d1c8e9174a7be5a61f56ff84dbb015e3e9a65bc084616123d77 Jul 02 20:30:58.185831 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.185799 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:30:58.185925 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.185906 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:30:58.185975 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.185956 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:30:58.933596 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.933560 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" event={"ID":"016200fe-f769-483d-97df-98b52cd699ed","Type":"ContainerStarted","Data":"662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab"} Jul 02 20:30:58.934020 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.933619 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" event={"ID":"016200fe-f769-483d-97df-98b52cd699ed","Type":"ContainerStarted","Data":"558209a539392d1c8e9174a7be5a61f56ff84dbb015e3e9a65bc084616123d77"} Jul 02 20:30:58.954311 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:58.954257 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" podStartSLOduration=1.9542415800000001 podStartE2EDuration="1.95424158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:58.952792001 +0000 UTC m=+2053.683234399" watchObservedRunningTime="2026-07-02 20:30:58.95424158 +0000 UTC m=+2053.684683963" Jul 02 20:30:59.039185 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:59.039101 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:59.044246 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:59.044212 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:59.939254 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:59.939225 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:30:59.940277 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:30:59.940260 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:01.089555 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.089517 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:01.188610 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.188574 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:01.256467 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.256437 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:01.608714 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.608680 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:01.783155 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.783122 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:01.884548 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.884519 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:01.952852 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.952822 2555 generic.go:356] "Generic (PLEG): container finished" podID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerID="4ea3bcc8e4ba896f96f9f9e46774a5cfde64feceb120b0c22fca0c477062a35c" exitCode=0 Jul 02 20:31:01.953030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.952904 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" event={"ID":"432bf9c5-f208-4dd2-8220-153631a0a8c3","Type":"ContainerDied","Data":"4ea3bcc8e4ba896f96f9f9e46774a5cfde64feceb120b0c22fca0c477062a35c"} Jul 02 20:31:01.953030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.952972 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" event={"ID":"432bf9c5-f208-4dd2-8220-153631a0a8c3","Type":"ContainerDied","Data":"0414bb4119d59dcfd968ee87eb0935bda590d249a87ab43f3487e1234fcf4bb9"} Jul 02 20:31:01.953030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.952998 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0414bb4119d59dcfd968ee87eb0935bda590d249a87ab43f3487e1234fcf4bb9" Jul 02 20:31:01.953030 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.953019 2555 scope.go:117] "RemoveContainer" containerID="53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0" Jul 02 20:31:01.965470 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:31:01.965443 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0\": container with ID starting with 53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0 not found: ID does not exist" containerID="53ac7eb3c21ceaf8257d7bd7e7343056f6577d2f168d8f957abff81f51aa3bd0" Jul 02 20:31:01.969103 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:01.969079 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:31:02.068795 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.068758 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-podinfo\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069000 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.068942 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-certs\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069000 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.068975 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-data\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069132 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069011 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w76gs\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-kube-api-access-w76gs\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069132 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069044 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-envoy\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069132 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069104 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-socket\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069286 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069144 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-token\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069286 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069230 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-credential-socket\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.069286 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069269 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/432bf9c5-f208-4dd2-8220-153631a0a8c3-istiod-ca-cert\") pod \"432bf9c5-f208-4dd2-8220-153631a0a8c3\" (UID: \"432bf9c5-f208-4dd2-8220-153631a0a8c3\") " Jul 02 20:31:02.070002 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069263 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:02.070002 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069398 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:02.070002 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069656 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:02.070002 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069739 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/432bf9c5-f208-4dd2-8220-153631a0a8c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:31:02.070002 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.069996 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:02.071386 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.071364 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:31:02.071508 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.071397 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-kube-api-access-w76gs" (OuterVolumeSpecName: "kube-api-access-w76gs") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "kube-api-access-w76gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:31:02.071508 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.071452 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:31:02.071590 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.071536 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "432bf9c5-f208-4dd2-8220-153631a0a8c3" (UID: "432bf9c5-f208-4dd2-8220-153631a0a8c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171191 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-credential-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171225 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/432bf9c5-f208-4dd2-8220-153631a0a8c3-istiod-ca-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171239 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-podinfo\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171250 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171261 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-data\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171271 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w76gs\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-kube-api-access-w76gs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171284 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-envoy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171296 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/432bf9c5-f208-4dd2-8220-153631a0a8c3-workload-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.171830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.171306 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/432bf9c5-f208-4dd2-8220-153631a0a8c3-istio-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:02.958973 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.958943 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk" Jul 02 20:31:02.983187 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.983157 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk"] Jul 02 20:31:02.986919 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:02.986892 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fe96cd-openshift-default-6c74866c97-gp8dk"] Jul 02 20:31:03.873253 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:03.873219 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" path="/var/lib/kubelet/pods/432bf9c5-f208-4dd2-8220-153631a0a8c3/volumes" Jul 02 20:31:05.523027 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:05.522988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:06.085258 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.085223 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:06.336758 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.336679 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr"] Jul 02 20:31:06.337086 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.337074 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" Jul 02 20:31:06.337139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.337088 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" Jul 02 20:31:06.337139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.337103 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" Jul 02 20:31:06.337139 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.337108 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" Jul 02 20:31:06.337230 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.337182 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" Jul 02 20:31:06.337230 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.337191 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="432bf9c5-f208-4dd2-8220-153631a0a8c3" containerName="istio-proxy" Jul 02 20:31:06.341782 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.341759 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.344552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.344527 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-22355e-openshift-default-dockercfg-mb5q4\"" Jul 02 20:31:06.352477 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.352450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr"] Jul 02 20:31:06.364145 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.364119 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:06.412624 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-socket\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412624 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-token\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412846 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412646 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istiod-ca-cert\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412846 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-envoy\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412846 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-credential-socket\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412846 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlh72\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-kube-api-access-hlh72\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412846 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-data\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.412846 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-certs\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.413072 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.412903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-podinfo\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514077 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514027 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-credential-socket\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlh72\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-kube-api-access-hlh72\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-data\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-certs\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514210 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-podinfo\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514288 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514262 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-socket\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514568 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-token\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514568 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-credential-socket\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514673 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514610 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-data\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514673 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514651 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-certs\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514785 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-socket\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514785 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istiod-ca-cert\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.514785 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.514738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-envoy\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.515258 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.515238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istiod-ca-cert\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.516719 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.516695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-podinfo\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.516827 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.516706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-envoy\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.523483 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.523448 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-token\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.523856 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.523544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlh72\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-kube-api-access-hlh72\") pod \"e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.652716 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.652625 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:06.694553 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.694523 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:06.794614 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.794586 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr"] Jul 02 20:31:06.796765 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:31:06.796739 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fd471d_27f7_4fe2_99a7_4e11812e7177.slice/crio-a9b90a6df29e0f67badfdd708885283b430b7a38e4a11750dcc730500f6ab31c WatchSource:0}: Error finding container a9b90a6df29e0f67badfdd708885283b430b7a38e4a11750dcc730500f6ab31c: Status 404 returned error can't find the container with id a9b90a6df29e0f67badfdd708885283b430b7a38e4a11750dcc730500f6ab31c Jul 02 20:31:06.799025 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.798995 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:06.799110 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.799058 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:06.799110 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.799084 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:06.981569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.981475 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" event={"ID":"b8fd471d-27f7-4fe2-99a7-4e11812e7177","Type":"ContainerStarted","Data":"e5a5104ad268a81f415b7510000f42b9be74faf6af44fccbeb3ba70b9b23266e"} Jul 02 20:31:06.981569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:06.981541 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" event={"ID":"b8fd471d-27f7-4fe2-99a7-4e11812e7177","Type":"ContainerStarted","Data":"a9b90a6df29e0f67badfdd708885283b430b7a38e4a11750dcc730500f6ab31c"} Jul 02 20:31:07.001220 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:07.001158 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" podStartSLOduration=1.001134318 podStartE2EDuration="1.001134318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:31:06.998803762 +0000 UTC m=+2061.729246179" watchObservedRunningTime="2026-07-02 20:31:07.001134318 +0000 UTC m=+2061.731576725" Jul 02 20:31:07.657373 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:07.656704 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:07.661348 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:07.661318 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:07.986401 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:07.986309 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:07.987319 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:07.987296 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:09.078924 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:09.078889 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:09.167577 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:09.167543 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:09.237409 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:09.237365 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:09.410278 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:09.410177 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:09.735324 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:09.735234 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:09.837083 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:09.837046 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:13.612886 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:13.612815 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:15.974796 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:15.974011 2555 patch_prober.go:28] interesting pod/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 02 20:31:15.974796 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:15.974125 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 02 20:31:16.038432 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:16.038400 2555 generic.go:356] "Generic (PLEG): container finished" podID="016200fe-f769-483d-97df-98b52cd699ed" containerID="662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab" exitCode=0 Jul 02 20:31:16.038591 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:16.038477 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" event={"ID":"016200fe-f769-483d-97df-98b52cd699ed","Type":"ContainerDied","Data":"662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab"} Jul 02 20:31:16.038909 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:16.038895 2555 scope.go:117] "RemoveContainer" containerID="662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab" Jul 02 20:31:16.039860 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:16.039834 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:16.039947 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:16.039916 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:16.039988 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:16.039948 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:17.045978 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:17.045925 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" event={"ID":"016200fe-f769-483d-97df-98b52cd699ed","Type":"ContainerStarted","Data":"111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d"} Jul 02 20:31:18.039971 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:18.039931 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:18.040212 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:18.040188 2555 patch_prober.go:28] interesting pod/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 02 20:31:18.040265 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:18.040242 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 02 20:31:19.040272 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:19.040233 2555 patch_prober.go:28] interesting pod/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 02 20:31:19.040666 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:19.040310 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 02 20:31:20.040424 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:20.040271 2555 patch_prober.go:28] interesting pod/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 02 20:31:20.040424 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:20.040330 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 02 20:31:21.042535 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:21.042503 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:21.042980 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:21.042760 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:21.043502 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:21.043484 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:21.789887 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:21.789827 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:22.184638 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:22.184483 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:22.287560 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:22.287423 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:22.434473 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:22.434444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:26.099342 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:26.099256 2555 generic.go:356] "Generic (PLEG): container finished" podID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerID="e5a5104ad268a81f415b7510000f42b9be74faf6af44fccbeb3ba70b9b23266e" exitCode=0 Jul 02 20:31:26.099746 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:26.099336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" event={"ID":"b8fd471d-27f7-4fe2-99a7-4e11812e7177","Type":"ContainerDied","Data":"e5a5104ad268a81f415b7510000f42b9be74faf6af44fccbeb3ba70b9b23266e"} Jul 02 20:31:26.099806 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:26.099764 2555 scope.go:117] "RemoveContainer" containerID="e5a5104ad268a81f415b7510000f42b9be74faf6af44fccbeb3ba70b9b23266e" Jul 02 20:31:26.100854 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:26.100824 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:26.100954 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:26.100933 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:26.100996 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:26.100979 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:27.112078 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:27.112038 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" event={"ID":"b8fd471d-27f7-4fe2-99a7-4e11812e7177","Type":"ContainerStarted","Data":"9e4908ba08c25ead808b5182f544b96949e3becc4f531dd2668ef366bca14c8d"} Jul 02 20:31:27.653422 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:27.653383 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:27.653722 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:27.653695 2555 patch_prober.go:28] interesting pod/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:31:27.653813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:27.653756 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 02 20:31:27.875252 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:27.875215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:27.975954 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:27.975854 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:28.118133 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.115671 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679"] Jul 02 20:31:28.118133 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.115932 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" containerID="cri-o://111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d" gracePeriod=30 Jul 02 20:31:28.126868 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.126816 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:28.407442 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.407362 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:28.653778 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.653742 2555 patch_prober.go:28] interesting pod/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:31:28.653991 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.653797 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 02 20:31:28.718913 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:28.718793 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:29.058374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:29.058338 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:29.161427 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:29.161393 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:29.261506 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:29.261466 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:29.377434 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:29.377322 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:29.653838 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:29.653747 2555 patch_prober.go:28] interesting pod/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:31:29.653838 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:29.653804 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 02 20:31:30.653043 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:30.653009 2555 patch_prober.go:28] interesting pod/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 02 20:31:30.653444 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:30.653066 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 02 20:31:31.656390 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:31.656361 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:31.656810 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:31.656722 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:31.657412 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:31.657394 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:33.371559 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.371536 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:33.485202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485115 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-data\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485151 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-envoy\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485180 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/016200fe-f769-483d-97df-98b52cd699ed-istio-podinfo\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485202 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485197 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-credential-socket\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485538 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485240 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-istio-token\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485538 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485307 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlphz\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-kube-api-access-jlphz\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485538 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485338 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-socket\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485538 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485367 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/016200fe-f769-483d-97df-98b52cd699ed-istiod-ca-cert\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485538 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485384 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-certs\") pod \"016200fe-f769-483d-97df-98b52cd699ed\" (UID: \"016200fe-f769-483d-97df-98b52cd699ed\") " Jul 02 20:31:33.485808 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485656 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:33.485808 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485667 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:33.485957 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.485903 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:33.486081 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486030 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016200fe-f769-483d-97df-98b52cd699ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:31:33.486081 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486049 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:33.486302 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486211 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.486302 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486231 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/016200fe-f769-483d-97df-98b52cd699ed-istiod-ca-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.486302 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486254 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-workload-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.486302 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486267 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-data\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.486302 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.486281 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-credential-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.487484 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.487462 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:33.487566 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.487542 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/016200fe-f769-483d-97df-98b52cd699ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:31:33.487611 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.487565 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:31:33.487650 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.487624 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-kube-api-access-jlphz" (OuterVolumeSpecName: "kube-api-access-jlphz") pod "016200fe-f769-483d-97df-98b52cd699ed" (UID: "016200fe-f769-483d-97df-98b52cd699ed"). InnerVolumeSpecName "kube-api-access-jlphz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:31:33.587449 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.587405 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlphz\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-kube-api-access-jlphz\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.587449 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.587441 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/016200fe-f769-483d-97df-98b52cd699ed-istio-envoy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.587449 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.587450 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/016200fe-f769-483d-97df-98b52cd699ed-istio-podinfo\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:33.587449 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:33.587458 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/016200fe-f769-483d-97df-98b52cd699ed-istio-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:34.159770 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.159675 2555 generic.go:356] "Generic (PLEG): container finished" podID="016200fe-f769-483d-97df-98b52cd699ed" containerID="111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d" exitCode=0 Jul 02 20:31:34.159770 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.159723 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" Jul 02 20:31:34.159770 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.159730 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" event={"ID":"016200fe-f769-483d-97df-98b52cd699ed","Type":"ContainerDied","Data":"111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d"} Jul 02 20:31:34.159770 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.159770 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679" event={"ID":"016200fe-f769-483d-97df-98b52cd699ed","Type":"ContainerDied","Data":"558209a539392d1c8e9174a7be5a61f56ff84dbb015e3e9a65bc084616123d77"} Jul 02 20:31:34.160106 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.159791 2555 scope.go:117] "RemoveContainer" containerID="111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d" Jul 02 20:31:34.171021 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.171000 2555 scope.go:117] "RemoveContainer" containerID="662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab" Jul 02 20:31:34.179434 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.179407 2555 scope.go:117] "RemoveContainer" containerID="111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d" Jul 02 20:31:34.179777 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:31:34.179749 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d\": container with ID starting with 111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d not found: ID does not exist" containerID="111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d" Jul 02 20:31:34.179869 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.179788 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d"} err="failed to get container status \"111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d\": rpc error: code = NotFound desc = could not find container \"111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d\": container with ID starting with 111129a774436c284173300ac76bd9347f9e8769f8f73d5758c7e9206cba096d not found: ID does not exist" Jul 02 20:31:34.179869 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.179813 2555 scope.go:117] "RemoveContainer" containerID="662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab" Jul 02 20:31:34.180135 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:31:34.180116 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab\": container with ID starting with 662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab not found: ID does not exist" containerID="662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab" Jul 02 20:31:34.180183 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.180142 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab"} err="failed to get container status \"662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab\": rpc error: code = NotFound desc = could not find container \"662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab\": container with ID starting with 662893765e35dd5e0393af8fe23b6043bfcd43d837ac3459c27e51ba52ae43ab not found: ID does not exist" Jul 02 20:31:34.181080 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.181062 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679"] Jul 02 20:31:34.187445 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.187422 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9f6297-openshift-default-6bdcf794f7-lp679"] Jul 02 20:31:34.782746 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.782717 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:34.883387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:34.883338 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:35.029547 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.029516 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr"] Jul 02 20:31:35.029726 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.029703 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" containerID="cri-o://9e4908ba08c25ead808b5182f544b96949e3becc4f531dd2668ef366bca14c8d" gracePeriod=30 Jul 02 20:31:35.051417 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.051335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:35.276163 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.276135 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:35.636739 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.636699 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:35.872377 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.872341 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016200fe-f769-483d-97df-98b52cd699ed" path="/var/lib/kubelet/pods/016200fe-f769-483d-97df-98b52cd699ed/volumes" Jul 02 20:31:35.916666 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.916586 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq"] Jul 02 20:31:35.917001 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.916989 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" Jul 02 20:31:35.917053 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.917004 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" Jul 02 20:31:35.917053 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.917020 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" Jul 02 20:31:35.917053 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.917026 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" Jul 02 20:31:35.917145 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.917122 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" Jul 02 20:31:35.917145 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.917133 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="016200fe-f769-483d-97df-98b52cd699ed" containerName="istio-proxy" Jul 02 20:31:35.920068 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.920046 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:35.923075 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.923055 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c4a4b5-openshift-default-dockercfg-2k66c\"" Jul 02 20:31:35.932987 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.932961 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq"] Jul 02 20:31:35.943855 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:35.943828 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:36.016599 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-credential-socket\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.016829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-certs\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.016829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istiod-ca-cert\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.016829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-socket\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.016829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-envoy\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.017061 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-podinfo\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.017061 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-data\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.017061 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.016932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-token\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.017061 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.017009 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dckc\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-kube-api-access-6dckc\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118316 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-credential-socket\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118316 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-certs\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istiod-ca-cert\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-socket\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118406 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-envoy\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118437 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-podinfo\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118460 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-data\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118489 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-token\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118547 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dckc\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-kube-api-access-6dckc\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118935 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118747 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-certs\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118935 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118781 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-socket\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.118935 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.118830 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-credential-socket\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.119100 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.119071 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-data\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.119179 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.119161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istiod-ca-cert\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.120679 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.120662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-envoy\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.121032 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.121015 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-podinfo\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.127206 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.127175 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-token\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.127809 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.127786 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dckc\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-kube-api-access-6dckc\") pod \"e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.231183 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.231093 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:36.408170 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.408136 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq"] Jul 02 20:31:36.418466 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:31:36.418429 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4872333a_e6f0_408f_9a99_5e674ebd3ad1.slice/crio-bf6d0a457a5615613eb0d8c054d01986232f94817fce0bca7e30ec329d866ee6 WatchSource:0}: Error finding container bf6d0a457a5615613eb0d8c054d01986232f94817fce0bca7e30ec329d866ee6: Status 404 returned error can't find the container with id bf6d0a457a5615613eb0d8c054d01986232f94817fce0bca7e30ec329d866ee6 Jul 02 20:31:36.420557 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.420520 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:36.420633 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.420607 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:36.420672 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.420649 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:36.588665 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.588624 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:36.685150 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:36.685092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:37.177857 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:37.177807 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" event={"ID":"4872333a-e6f0-408f-9a99-5e674ebd3ad1","Type":"ContainerStarted","Data":"6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa"} Jul 02 20:31:37.178289 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:37.177901 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" event={"ID":"4872333a-e6f0-408f-9a99-5e674ebd3ad1","Type":"ContainerStarted","Data":"bf6d0a457a5615613eb0d8c054d01986232f94817fce0bca7e30ec329d866ee6"} Jul 02 20:31:37.202016 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:37.201968 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" podStartSLOduration=2.201951573 podStartE2EDuration="2.201951573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:31:37.199684887 +0000 UTC m=+2091.930127295" watchObservedRunningTime="2026-07-02 20:31:37.201951573 +0000 UTC m=+2091.932393979" Jul 02 20:31:37.231719 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:37.231683 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:37.236601 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:37.236576 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:38.183335 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:38.183295 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:38.184246 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:38.184226 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:39.251797 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:39.251765 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:39.353161 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:39.353132 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:39.453093 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:39.453061 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:39.756053 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:39.756018 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:39.855924 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:39.855871 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:39.954721 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:39.954683 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:40.197653 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.197622 2555 generic.go:356] "Generic (PLEG): container finished" podID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerID="9e4908ba08c25ead808b5182f544b96949e3becc4f531dd2668ef366bca14c8d" exitCode=0 Jul 02 20:31:40.197811 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.197699 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" event={"ID":"b8fd471d-27f7-4fe2-99a7-4e11812e7177","Type":"ContainerDied","Data":"9e4908ba08c25ead808b5182f544b96949e3becc4f531dd2668ef366bca14c8d"} Jul 02 20:31:40.197811 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.197765 2555 scope.go:117] "RemoveContainer" containerID="e5a5104ad268a81f415b7510000f42b9be74faf6af44fccbeb3ba70b9b23266e" Jul 02 20:31:40.293614 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.293554 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:40.358194 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358156 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-certs\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358214 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-token\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358267 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlh72\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-kube-api-access-hlh72\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358313 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-envoy\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358365 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-socket\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358392 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-credential-socket\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358429 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-podinfo\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358472 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istiod-ca-cert\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358519 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-data\") pod \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\" (UID: \"b8fd471d-27f7-4fe2-99a7-4e11812e7177\") " Jul 02 20:31:40.358711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358519 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:40.359012 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.358712 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:40.359072 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.359011 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.359072 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.359016 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:31:40.359072 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.359030 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-workload-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.359594 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.359498 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:40.359594 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.359535 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:40.361402 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.361375 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:31:40.361575 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.361553 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:31:40.361642 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.361553 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:31:40.361642 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.361557 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-kube-api-access-hlh72" (OuterVolumeSpecName: "kube-api-access-hlh72") pod "b8fd471d-27f7-4fe2-99a7-4e11812e7177" (UID: "b8fd471d-27f7-4fe2-99a7-4e11812e7177"). InnerVolumeSpecName "kube-api-access-hlh72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:31:40.460377 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460345 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istiod-ca-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.460377 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460371 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-data\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.460377 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460379 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.460616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460388 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlh72\" (UniqueName: \"kubernetes.io/projected/b8fd471d-27f7-4fe2-99a7-4e11812e7177-kube-api-access-hlh72\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.460616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460399 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-envoy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.460616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460411 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8fd471d-27f7-4fe2-99a7-4e11812e7177-credential-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:40.460616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:40.460419 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8fd471d-27f7-4fe2-99a7-4e11812e7177-istio-podinfo\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:31:41.204282 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:41.204247 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" Jul 02 20:31:41.204486 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:41.204242 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr" event={"ID":"b8fd471d-27f7-4fe2-99a7-4e11812e7177","Type":"ContainerDied","Data":"a9b90a6df29e0f67badfdd708885283b430b7a38e4a11750dcc730500f6ab31c"} Jul 02 20:31:41.204486 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:41.204380 2555 scope.go:117] "RemoveContainer" containerID="9e4908ba08c25ead808b5182f544b96949e3becc4f531dd2668ef366bca14c8d" Jul 02 20:31:41.226572 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:41.226547 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr"] Jul 02 20:31:41.229984 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:41.229948 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-22355e-openshift-default-58445c8ffc-2n6xr"] Jul 02 20:31:41.873213 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:41.873179 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" path="/var/lib/kubelet/pods/b8fd471d-27f7-4fe2-99a7-4e11812e7177/volumes" Jul 02 20:31:43.818345 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:43.818311 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:44.145286 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.145196 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:44.424177 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.424086 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr"] Jul 02 20:31:44.424840 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.424759 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" Jul 02 20:31:44.424840 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.424796 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" Jul 02 20:31:44.425062 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.424855 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" Jul 02 20:31:44.425062 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.424864 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" Jul 02 20:31:44.425062 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.425015 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" Jul 02 20:31:44.429639 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.429618 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.432007 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.431988 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fd52f9-openshift-default-dockercfg-x2fk2\"" Jul 02 20:31:44.441979 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.441953 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr"] Jul 02 20:31:44.456147 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.456106 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:44.604151 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-certs\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604151 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-token\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmxc\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-kube-api-access-jgmxc\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-podinfo\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-data\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-socket\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604338 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-credential-socket\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istiod-ca-cert\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.604431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.604420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-envoy\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.705568 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.705467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istiod-ca-cert\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.705830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.705810 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-envoy\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.706072 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.706054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-certs\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.706197 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.706183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-token\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.706332 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.706304 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istiod-ca-cert\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.706507 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.706315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmxc\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-kube-api-access-jgmxc\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.706680 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.706537 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-certs\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.706864 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.706675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-podinfo\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.707070 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.707047 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-data\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.707493 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.707474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-socket\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.707902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.707870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-credential-socket\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.708330 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.707822 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-socket\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.708463 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.707411 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-data\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.708569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.708248 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-credential-socket\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.710183 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.710146 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-envoy\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.710680 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.710661 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-podinfo\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.715353 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.715337 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-token\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.715993 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.715967 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmxc\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-kube-api-access-jgmxc\") pod \"e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.741059 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.741028 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:44.914272 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.914236 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr"] Jul 02 20:31:44.916394 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:31:44.916335 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb391b3d0_0ebb_45f1_bcab_58669e6a0e16.slice/crio-547c3eca4df32e100ad0d9ff15421e0ab50f03679747f28cd6d28b1f45bbad08 WatchSource:0}: Error finding container 547c3eca4df32e100ad0d9ff15421e0ab50f03679747f28cd6d28b1f45bbad08: Status 404 returned error can't find the container with id 547c3eca4df32e100ad0d9ff15421e0ab50f03679747f28cd6d28b1f45bbad08 Jul 02 20:31:44.918638 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.918609 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:44.918724 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.918675 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:44.918724 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:44.918699 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:45.197617 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.197532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:45.228917 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.228807 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" event={"ID":"b391b3d0-0ebb-45f1-bcab-58669e6a0e16","Type":"ContainerStarted","Data":"29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233"} Jul 02 20:31:45.229096 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.228928 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" event={"ID":"b391b3d0-0ebb-45f1-bcab-58669e6a0e16","Type":"ContainerStarted","Data":"547c3eca4df32e100ad0d9ff15421e0ab50f03679747f28cd6d28b1f45bbad08"} Jul 02 20:31:45.251498 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.251440 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podStartSLOduration=1.251418319 podStartE2EDuration="1.251418319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:31:45.249213485 +0000 UTC m=+2099.979655892" watchObservedRunningTime="2026-07-02 20:31:45.251418319 +0000 UTC m=+2099.981860727" Jul 02 20:31:45.741679 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.741644 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:45.746637 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.746614 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:45.939119 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.939088 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:31:45.942598 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:45.942576 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:31:46.235338 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:46.235307 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:46.236254 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:46.236232 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:31:47.309359 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:47.309265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:47.405810 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:47.405759 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:47.476221 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:47.476184 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:47.835594 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:47.835563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:47.945295 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:47.945208 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:48.036540 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:48.036506 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:51.262068 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.262034 2555 generic.go:356] "Generic (PLEG): container finished" podID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerID="6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa" exitCode=0 Jul 02 20:31:51.262546 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.262106 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" event={"ID":"4872333a-e6f0-408f-9a99-5e674ebd3ad1","Type":"ContainerDied","Data":"6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa"} Jul 02 20:31:51.262546 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.262507 2555 scope.go:117] "RemoveContainer" containerID="6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa" Jul 02 20:31:51.263546 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.263517 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:51.263653 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.263599 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:51.263653 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.263644 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:31:51.853090 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:51.853058 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:31:52.269199 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:52.269166 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" event={"ID":"4872333a-e6f0-408f-9a99-5e674ebd3ad1","Type":"ContainerStarted","Data":"92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b"} Jul 02 20:31:53.184245 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:53.184202 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:53.232057 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:53.232022 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:53.233297 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:53.233273 2555 patch_prober.go:28] interesting pod/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:31:53.233357 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:53.233325 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 02 20:31:54.231813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:54.231767 2555 patch_prober.go:28] interesting pod/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:31:54.232261 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:54.231831 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 02 20:31:55.231477 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:55.231435 2555 patch_prober.go:28] interesting pod/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 02 20:31:55.231634 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:55.231508 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 02 20:31:56.236017 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:56.235982 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:31:56.236871 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:31:56.236852 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:32:00.525102 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:00.525066 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:00.627329 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:00.627282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:05.345960 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:05.345930 2555 generic.go:356] "Generic (PLEG): container finished" podID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerID="29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233" exitCode=0 Jul 02 20:32:05.346397 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:05.346003 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" event={"ID":"b391b3d0-0ebb-45f1-bcab-58669e6a0e16","Type":"ContainerDied","Data":"29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233"} Jul 02 20:32:05.346442 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:05.346424 2555 scope.go:117] "RemoveContainer" containerID="29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233" Jul 02 20:32:05.347420 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:05.347397 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:32:05.347481 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:05.347460 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:32:05.347518 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:05.347491 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:32:06.353479 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:06.353441 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" event={"ID":"b391b3d0-0ebb-45f1-bcab-58669e6a0e16","Type":"ContainerStarted","Data":"9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e"} Jul 02 20:32:06.524563 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:06.524526 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:06.742198 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:06.742159 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:32:06.742423 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:06.742397 2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:32:06.742483 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:06.742464 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 02 20:32:07.741531 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:07.741484 2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:32:07.742031 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:07.741562 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 02 20:32:08.692196 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:08.692125 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:08.742421 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:08.742388 2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:32:08.742793 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:08.742444 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 02 20:32:08.791692 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:08.791656 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:09.742367 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:09.742328 2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 02 20:32:09.742624 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:09.742398 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 02 20:32:10.745645 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:10.745615 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:32:10.746135 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:10.745904 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:32:10.746673 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:10.746657 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:32:58.111696 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.111658 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv"] Jul 02 20:32:58.112210 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.112171 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fd471d-27f7-4fe2-99a7-4e11812e7177" containerName="istio-proxy" Jul 02 20:32:58.114305 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.114286 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.118295 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.118269 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd52f9\"/\"openshift-service-ca.crt\"" Jul 02 20:32:58.118295 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.118284 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-fd52f9\"/\"kube-root-ca.crt\"" Jul 02 20:32:58.118480 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.118273 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd52f9\"/\"default-dockercfg-w6cjw\"" Jul 02 20:32:58.118480 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.118326 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-fd52f9\"/\"auth-test-model-fd52f9-kserve-self-signed-certs\"" Jul 02 20:32:58.127588 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.127569 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv"] Jul 02 20:32:58.146248 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.146221 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:32:58.255271 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.255234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tls-certs\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.255442 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.255276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-dshm\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.255442 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.255336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-home\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.255442 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.255358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-model-cache\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.255553 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.255445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj56v\" (UniqueName: \"kubernetes.io/projected/1dc24cc1-22fe-4d4d-87b5-40f625191c30-kube-api-access-rj56v\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.255553 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.255467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tmp-dir\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.356892 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.356840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj56v\" (UniqueName: \"kubernetes.io/projected/1dc24cc1-22fe-4d4d-87b5-40f625191c30-kube-api-access-rj56v\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357086 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.356907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tmp-dir\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357086 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.356957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tls-certs\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357086 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.356984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-dshm\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357251 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.357116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-home\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357251 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.357156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-model-cache\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357435 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.357416 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tmp-dir\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357494 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.357466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-home\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.357531 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.357500 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-model-cache\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.359190 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.359171 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-dshm\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.359439 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.359421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tls-certs\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.364963 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.364898 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj56v\" (UniqueName: \"kubernetes.io/projected/1dc24cc1-22fe-4d4d-87b5-40f625191c30-kube-api-access-rj56v\") pod \"auth-test-model-fd52f9-kserve-5657848ff-5shxv\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.423765 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.423726 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:32:58.557396 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.557366 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv"] Jul 02 20:32:58.558080 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:32:58.558050 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dc24cc1_22fe_4d4d_87b5_40f625191c30.slice/crio-297d35efb2e69313c1e54a7add71042fb43c299722265310ebf616bbadb89ae3 WatchSource:0}: Error finding container 297d35efb2e69313c1e54a7add71042fb43c299722265310ebf616bbadb89ae3: Status 404 returned error can't find the container with id 297d35efb2e69313c1e54a7add71042fb43c299722265310ebf616bbadb89ae3 Jul 02 20:32:58.629387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.629309 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" event={"ID":"1dc24cc1-22fe-4d4d-87b5-40f625191c30","Type":"ContainerStarted","Data":"65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19"} Jul 02 20:32:58.629387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.629359 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" event={"ID":"1dc24cc1-22fe-4d4d-87b5-40f625191c30","Type":"ContainerStarted","Data":"297d35efb2e69313c1e54a7add71042fb43c299722265310ebf616bbadb89ae3"} Jul 02 20:32:58.650398 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:32:58.650351 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" podStartSLOduration=0.650335442 podStartE2EDuration="650.335442ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:58.647951023 +0000 UTC m=+2173.378393434" watchObservedRunningTime="2026-07-02 20:32:58.650335442 +0000 UTC m=+2173.380777848" Jul 02 20:33:08.424639 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:33:08.424600 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:33:08.425154 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:33:08.424675 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:33:08.437289 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:33:08.437260 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:33:08.690084 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:33:08.690007 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:34:16.053020 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:34:16.052936 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:17.228624 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:34:17.228584 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:48.528953 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:34:48.528904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:58.161762 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:34:58.161729 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:34:59.018798 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:34:59.018762 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv"] Jul 02 20:34:59.043298 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:34:59.043261 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:35:12.535834 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:12.535799 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:35:14.039484 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.039440 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" podUID="1dc24cc1-22fe-4d4d-87b5-40f625191c30" containerName="main" containerID="cri-o://65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19" gracePeriod=45 Jul 02 20:35:14.285552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.285528 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:35:14.336314 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.336227 2555 generic.go:356] "Generic (PLEG): container finished" podID="1dc24cc1-22fe-4d4d-87b5-40f625191c30" containerID="65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19" exitCode=0 Jul 02 20:35:14.336314 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.336265 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" Jul 02 20:35:14.336314 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.336283 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" event={"ID":"1dc24cc1-22fe-4d4d-87b5-40f625191c30","Type":"ContainerDied","Data":"65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19"} Jul 02 20:35:14.336584 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.336325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv" event={"ID":"1dc24cc1-22fe-4d4d-87b5-40f625191c30","Type":"ContainerDied","Data":"297d35efb2e69313c1e54a7add71042fb43c299722265310ebf616bbadb89ae3"} Jul 02 20:35:14.336584 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.336348 2555 scope.go:117] "RemoveContainer" containerID="65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19" Jul 02 20:35:14.344830 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.344813 2555 scope.go:117] "RemoveContainer" containerID="65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19" Jul 02 20:35:14.345116 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:35:14.345101 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19\": container with ID starting with 65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19 not found: ID does not exist" containerID="65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19" Jul 02 20:35:14.345178 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.345124 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19"} err="failed to get container status \"65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19\": rpc error: code = NotFound desc = could not find container \"65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19\": container with ID starting with 65994a2ec7378b30cb0d4141c0c29fb5cf4827bd1da5efc089f1a9144a68ff19 not found: ID does not exist" Jul 02 20:35:14.433382 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433351 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tls-certs\") pod \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " Jul 02 20:35:14.433552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433443 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tmp-dir\") pod \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " Jul 02 20:35:14.433552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433476 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-home\") pod \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " Jul 02 20:35:14.433552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433516 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-model-cache\") pod \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " Jul 02 20:35:14.433552 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433545 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj56v\" (UniqueName: \"kubernetes.io/projected/1dc24cc1-22fe-4d4d-87b5-40f625191c30-kube-api-access-rj56v\") pod \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " Jul 02 20:35:14.433743 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433592 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-dshm\") pod \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\" (UID: \"1dc24cc1-22fe-4d4d-87b5-40f625191c30\") " Jul 02 20:35:14.433800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433735 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-home" (OuterVolumeSpecName: "home") pod "1dc24cc1-22fe-4d4d-87b5-40f625191c30" (UID: "1dc24cc1-22fe-4d4d-87b5-40f625191c30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:35:14.433800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433752 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1dc24cc1-22fe-4d4d-87b5-40f625191c30" (UID: "1dc24cc1-22fe-4d4d-87b5-40f625191c30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:35:14.433800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433786 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-model-cache" (OuterVolumeSpecName: "model-cache") pod "1dc24cc1-22fe-4d4d-87b5-40f625191c30" (UID: "1dc24cc1-22fe-4d4d-87b5-40f625191c30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:35:14.434009 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.433983 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tmp-dir\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:35:14.434054 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.434014 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-home\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:35:14.434054 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.434029 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-model-cache\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:35:14.435714 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.435680 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-dshm" (OuterVolumeSpecName: "dshm") pod "1dc24cc1-22fe-4d4d-87b5-40f625191c30" (UID: "1dc24cc1-22fe-4d4d-87b5-40f625191c30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:35:14.435828 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.435738 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1dc24cc1-22fe-4d4d-87b5-40f625191c30" (UID: "1dc24cc1-22fe-4d4d-87b5-40f625191c30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:35:14.435828 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.435747 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dc24cc1-22fe-4d4d-87b5-40f625191c30-kube-api-access-rj56v" (OuterVolumeSpecName: "kube-api-access-rj56v") pod "1dc24cc1-22fe-4d4d-87b5-40f625191c30" (UID: "1dc24cc1-22fe-4d4d-87b5-40f625191c30"). InnerVolumeSpecName "kube-api-access-rj56v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:35:14.535185 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.535145 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1dc24cc1-22fe-4d4d-87b5-40f625191c30-tls-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:35:14.535185 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.535178 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj56v\" (UniqueName: \"kubernetes.io/projected/1dc24cc1-22fe-4d4d-87b5-40f625191c30-kube-api-access-rj56v\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:35:14.535396 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.535193 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1dc24cc1-22fe-4d4d-87b5-40f625191c30-dshm\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:35:14.659272 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.659238 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv"] Jul 02 20:35:14.662472 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:14.662447 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-fd52f9/auth-test-model-fd52f9-kserve-5657848ff-5shxv"] Jul 02 20:35:15.872800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:15.872766 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dc24cc1-22fe-4d4d-87b5-40f625191c30" path="/var/lib/kubelet/pods/1dc24cc1-22fe-4d4d-87b5-40f625191c30/volumes" Jul 02 20:35:17.661916 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:17.661838 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:35:27.007574 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:27.007542 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:35:29.895755 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:29.895722 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:35:46.047479 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:46.047446 2555 scope.go:117] "RemoveContainer" containerID="4ea3bcc8e4ba896f96f9f9e46774a5cfde64feceb120b0c22fca0c477062a35c" Jul 02 20:35:57.624144 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:57.624093 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:35:57.723952 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:35:57.723921 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:36:02.608816 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:02.608779 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:36:03.416921 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:03.416866 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:36:15.414111 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.414074 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc"] Jul 02 20:36:15.414535 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.414519 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc24cc1-22fe-4d4d-87b5-40f625191c30" containerName="main" Jul 02 20:36:15.414535 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.414536 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc24cc1-22fe-4d4d-87b5-40f625191c30" containerName="main" Jul 02 20:36:15.414618 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.414598 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc24cc1-22fe-4d4d-87b5-40f625191c30" containerName="main" Jul 02 20:36:15.417705 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.417689 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.420163 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.420145 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c4a4b5\"/\"kube-root-ca.crt\"" Jul 02 20:36:15.421252 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.421228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4a4b5\"/\"default-dockercfg-x5n8b\"" Jul 02 20:36:15.421351 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.421228 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c4a4b5\"/\"openshift-service-ca.crt\"" Jul 02 20:36:15.421351 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.421331 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c4a4b5\"/\"rate-test-model-c4a4b5-kserve-self-signed-certs\"" Jul 02 20:36:15.430921 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.430892 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc"] Jul 02 20:36:15.443320 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.443289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:36:15.537739 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.537702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-model-cache\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.537739 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.537742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tmp-dir\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.537994 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.537778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2b2v\" (UniqueName: \"kubernetes.io/projected/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-kube-api-access-m2b2v\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.537994 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.537841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-dshm\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.537994 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.537950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-home\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.538106 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.538002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tls-certs\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.638625 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.638586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2b2v\" (UniqueName: \"kubernetes.io/projected/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-kube-api-access-m2b2v\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.638625 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.638629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-dshm\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.638899 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.638658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-home\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.638899 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.638688 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tls-certs\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.638899 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.638736 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-model-cache\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.638899 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.638753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tmp-dir\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.639145 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.639124 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-home\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.639214 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.639144 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tmp-dir\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.639214 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.639190 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-model-cache\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.640935 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.640916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-dshm\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.641188 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.641172 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tls-certs\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.647238 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.647221 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2b2v\" (UniqueName: \"kubernetes.io/projected/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-kube-api-access-m2b2v\") pod \"rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.727523 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.727427 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:15.863017 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:15.862988 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc"] Jul 02 20:36:15.864955 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:36:15.864929 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c0aaa7e_2c13_4802_8c5e_d490b50f910a.slice/crio-02187f111572db54d2b30a4df9f6990d1d7cd8ca74fe095b7574b728b882dfe3 WatchSource:0}: Error finding container 02187f111572db54d2b30a4df9f6990d1d7cd8ca74fe095b7574b728b882dfe3: Status 404 returned error can't find the container with id 02187f111572db54d2b30a4df9f6990d1d7cd8ca74fe095b7574b728b882dfe3 Jul 02 20:36:16.662755 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:16.662709 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" event={"ID":"4c0aaa7e-2c13-4802-8c5e-d490b50f910a","Type":"ContainerStarted","Data":"bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23"} Jul 02 20:36:16.662755 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:16.662752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" event={"ID":"4c0aaa7e-2c13-4802-8c5e-d490b50f910a","Type":"ContainerStarted","Data":"02187f111572db54d2b30a4df9f6990d1d7cd8ca74fe095b7574b728b882dfe3"} Jul 02 20:36:16.679822 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:16.679774 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" podStartSLOduration=1.679760556 podStartE2EDuration="1.679760556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:36:16.678010133 +0000 UTC m=+2371.408452540" watchObservedRunningTime="2026-07-02 20:36:16.679760556 +0000 UTC m=+2371.410202963" Jul 02 20:36:25.728244 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:25.728208 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:25.728739 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:25.728534 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:25.740777 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:25.740747 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:26.731711 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:26.731683 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:36:45.973860 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:45.973822 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:36:45.978452 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:45.978430 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xwmpf_e253eedb-7b33-4e2a-b532-e0ac3a0545f8/ovn-acl-logging/0.log" Jul 02 20:36:46.071870 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:46.071837 2555 scope.go:117] "RemoveContainer" containerID="4d59c16e38466aef53099fbeebe2640f179d6b65657095fa3293fe23e24bc9f2" Jul 02 20:36:46.080449 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:46.080427 2555 scope.go:117] "RemoveContainer" containerID="e24c3c2ba32423ee450f7f16872e1af8e133deb8bae3eb2cbf4bc828cb7d72fe" Jul 02 20:36:49.734479 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:36:49.734444 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:01.312489 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:01.312452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:01.413616 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:01.413580 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:09.324646 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:09.324611 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:09.424943 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:09.424904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:09.526198 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:09.526158 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:33.495351 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:33.495310 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc"] Jul 02 20:37:33.520484 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:33.520454 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:34.311512 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:34.311478 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:35.534625 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:35.534592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:36.021896 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:36.021840 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:36.121372 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:36.121340 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:36.262213 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:36.262178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:41.183375 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:41.183335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:37:48.516245 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.516178 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" podUID="4c0aaa7e-2c13-4802-8c5e-d490b50f910a" containerName="main" containerID="cri-o://bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23" gracePeriod=45 Jul 02 20:37:48.774130 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.774056 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:37:48.878722 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.878662 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-model-cache\") pod \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " Jul 02 20:37:48.878722 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.878726 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-home\") pod \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " Jul 02 20:37:48.879041 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.878801 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tls-certs\") pod \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " Jul 02 20:37:48.879041 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.878824 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tmp-dir\") pod \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " Jul 02 20:37:48.879041 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.878859 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-dshm\") pod \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " Jul 02 20:37:48.879041 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.878965 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2b2v\" (UniqueName: \"kubernetes.io/projected/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-kube-api-access-m2b2v\") pod \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\" (UID: \"4c0aaa7e-2c13-4802-8c5e-d490b50f910a\") " Jul 02 20:37:48.879041 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.879004 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-home" (OuterVolumeSpecName: "home") pod "4c0aaa7e-2c13-4802-8c5e-d490b50f910a" (UID: "4c0aaa7e-2c13-4802-8c5e-d490b50f910a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:37:48.879041 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.879016 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c0aaa7e-2c13-4802-8c5e-d490b50f910a" (UID: "4c0aaa7e-2c13-4802-8c5e-d490b50f910a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:37:48.879371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.879123 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c0aaa7e-2c13-4802-8c5e-d490b50f910a" (UID: "4c0aaa7e-2c13-4802-8c5e-d490b50f910a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:37:48.879371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.879229 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tmp-dir\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:37:48.879371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.879240 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-model-cache\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:37:48.879371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.879250 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-home\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:37:48.881117 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.881095 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c0aaa7e-2c13-4802-8c5e-d490b50f910a" (UID: "4c0aaa7e-2c13-4802-8c5e-d490b50f910a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:37:48.881189 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.881118 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-kube-api-access-m2b2v" (OuterVolumeSpecName: "kube-api-access-m2b2v") pod "4c0aaa7e-2c13-4802-8c5e-d490b50f910a" (UID: "4c0aaa7e-2c13-4802-8c5e-d490b50f910a"). InnerVolumeSpecName "kube-api-access-m2b2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:37:48.881189 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.881176 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-dshm" (OuterVolumeSpecName: "dshm") pod "4c0aaa7e-2c13-4802-8c5e-d490b50f910a" (UID: "4c0aaa7e-2c13-4802-8c5e-d490b50f910a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:37:48.979972 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.979928 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-tls-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:37:48.979972 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.979962 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-dshm\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:37:48.979972 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:48.979973 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2b2v\" (UniqueName: \"kubernetes.io/projected/4c0aaa7e-2c13-4802-8c5e-d490b50f910a-kube-api-access-m2b2v\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:37:49.149284 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.149196 2555 generic.go:356] "Generic (PLEG): container finished" podID="4c0aaa7e-2c13-4802-8c5e-d490b50f910a" containerID="bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23" exitCode=0 Jul 02 20:37:49.149284 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.149240 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" Jul 02 20:37:49.149284 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.149269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" event={"ID":"4c0aaa7e-2c13-4802-8c5e-d490b50f910a","Type":"ContainerDied","Data":"bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23"} Jul 02 20:37:49.149535 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.149301 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc" event={"ID":"4c0aaa7e-2c13-4802-8c5e-d490b50f910a","Type":"ContainerDied","Data":"02187f111572db54d2b30a4df9f6990d1d7cd8ca74fe095b7574b728b882dfe3"} Jul 02 20:37:49.149535 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.149317 2555 scope.go:117] "RemoveContainer" containerID="bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23" Jul 02 20:37:49.158388 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.158370 2555 scope.go:117] "RemoveContainer" containerID="bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23" Jul 02 20:37:49.158647 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:37:49.158626 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23\": container with ID starting with bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23 not found: ID does not exist" containerID="bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23" Jul 02 20:37:49.158736 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.158655 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23"} err="failed to get container status \"bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23\": rpc error: code = NotFound desc = could not find container \"bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23\": container with ID starting with bf260b55ddf12c5d071928856dbef26b9f0d37bab235c34d752337bca93fcf23 not found: ID does not exist" Jul 02 20:37:49.171328 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.171299 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc"] Jul 02 20:37:49.175764 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.175738 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c4a4b5/rate-test-model-c4a4b5-kserve-677f7c4cb7-wx5pc"] Jul 02 20:37:49.874270 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:37:49.874222 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c0aaa7e-2c13-4802-8c5e-d490b50f910a" path="/var/lib/kubelet/pods/4c0aaa7e-2c13-4802-8c5e-d490b50f910a/volumes" Jul 02 20:38:18.007550 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:18.007519 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:18.278594 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:18.278486 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq"] Jul 02 20:38:18.278815 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:18.278767 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" containerID="cri-o://92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b" gracePeriod=30 Jul 02 20:38:18.291603 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:18.291572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:18.528827 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:18.528740 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:18.708844 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:18.708801 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:19.125569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:19.125537 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:19.223543 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:19.223503 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:19.376607 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:19.376526 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:23.536152 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.536125 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:38:23.629800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629712 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-credential-socket\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.629800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629772 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dckc\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-kube-api-access-6dckc\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.629800 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629794 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istiod-ca-cert\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630085 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629835 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-podinfo\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630085 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629870 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-data\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630085 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629938 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-envoy\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630085 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.629974 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-certs\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630085 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630002 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-token\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630085 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630062 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-socket\") pod \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\" (UID: \"4872333a-e6f0-408f-9a99-5e674ebd3ad1\") " Jul 02 20:38:23.630395 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630088 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:23.630395 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630325 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:23.630520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630396 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:38:23.630520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630417 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.630520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630436 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-credential-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.630520 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.630497 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:23.631118 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.631082 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-data" (OuterVolumeSpecName: "istio-data") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:23.632376 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.632337 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:23.632496 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.632428 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-token" (OuterVolumeSpecName: "istio-token") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:38:23.632621 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.632599 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:38:23.632945 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.632633 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-kube-api-access-6dckc" (OuterVolumeSpecName: "kube-api-access-6dckc") pod "4872333a-e6f0-408f-9a99-5e674ebd3ad1" (UID: "4872333a-e6f0-408f-9a99-5e674ebd3ad1"). InnerVolumeSpecName "kube-api-access-6dckc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:38:23.731154 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731118 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.731154 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731154 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-workload-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.731374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731169 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dckc\" (UniqueName: \"kubernetes.io/projected/4872333a-e6f0-408f-9a99-5e674ebd3ad1-kube-api-access-6dckc\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.731374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731183 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istiod-ca-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.731374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731196 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-podinfo\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.731374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731208 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-data\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:23.731374 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:23.731220 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4872333a-e6f0-408f-9a99-5e674ebd3ad1-istio-envoy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:24.333809 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.333770 2555 generic.go:356] "Generic (PLEG): container finished" podID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerID="92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b" exitCode=0 Jul 02 20:38:24.334009 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.333848 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" Jul 02 20:38:24.334009 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.333849 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" event={"ID":"4872333a-e6f0-408f-9a99-5e674ebd3ad1","Type":"ContainerDied","Data":"92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b"} Jul 02 20:38:24.334009 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.333919 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq" event={"ID":"4872333a-e6f0-408f-9a99-5e674ebd3ad1","Type":"ContainerDied","Data":"bf6d0a457a5615613eb0d8c054d01986232f94817fce0bca7e30ec329d866ee6"} Jul 02 20:38:24.334009 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.333943 2555 scope.go:117] "RemoveContainer" containerID="92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b" Jul 02 20:38:24.342705 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.342677 2555 scope.go:117] "RemoveContainer" containerID="6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa" Jul 02 20:38:24.351370 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.351087 2555 scope.go:117] "RemoveContainer" containerID="92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b" Jul 02 20:38:24.351464 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:38:24.351396 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b\": container with ID starting with 92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b not found: ID does not exist" containerID="92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b" Jul 02 20:38:24.351464 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.351435 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b"} err="failed to get container status \"92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b\": rpc error: code = NotFound desc = could not find container \"92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b\": container with ID starting with 92323fdb8114e0edf2bca92b724b748459dd0cb211aee46199c441e390da7e3b not found: ID does not exist" Jul 02 20:38:24.351464 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.351460 2555 scope.go:117] "RemoveContainer" containerID="6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa" Jul 02 20:38:24.351728 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:38:24.351706 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa\": container with ID starting with 6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa not found: ID does not exist" containerID="6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa" Jul 02 20:38:24.351780 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.351734 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa"} err="failed to get container status \"6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa\": rpc error: code = NotFound desc = could not find container \"6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa\": container with ID starting with 6a4df48eeb9bf05dfff0157979f93ccf6dffd55c0c379ba76a1d8073cb76c2fa not found: ID does not exist" Jul 02 20:38:24.353597 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.353575 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq"] Jul 02 20:38:24.359812 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:24.359789 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c4a4b5-openshift-default-64899cd895-2stmq"] Jul 02 20:38:25.064391 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.064356 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:25.165436 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.165404 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:25.342947 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.342836 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr"] Jul 02 20:38:25.343130 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.343102 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" containerID="cri-o://9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e" gracePeriod=30 Jul 02 20:38:25.367354 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.367317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:25.596580 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.596490 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:25.748730 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.748697 2555 patch_prober.go:28] interesting pod/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 20:38:25.748909 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.748753 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 20:38:25.872867 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:25.872781 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" path="/var/lib/kubelet/pods/4872333a-e6f0-408f-9a99-5e674ebd3ad1/volumes" Jul 02 20:38:26.066680 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:26.066646 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fdcb7d8bb-khkv4_74a79e17-23d2-4bdc-a181-6ed7883235b8/authorino/0.log" Jul 02 20:38:30.598656 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.598630 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:38:30.697303 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697215 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-data\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697303 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697274 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-envoy\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697495 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697330 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istiod-ca-cert\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697495 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697354 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgmxc\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-kube-api-access-jgmxc\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697495 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697394 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-podinfo\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697495 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697423 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-socket\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697495 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697473 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-token\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697752 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697502 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-certs\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697752 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697579 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-credential-socket\") pod \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\" (UID: \"b391b3d0-0ebb-45f1-bcab-58669e6a0e16\") " Jul 02 20:38:30.697865 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697750 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:38:30.697991 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.697978 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istiod-ca-cert\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.698073 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.698047 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:30.698147 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.698066 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:30.698218 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.698185 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:30.698342 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.698309 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-data" (OuterVolumeSpecName: "istio-data") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:30.699642 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.699619 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:30.699732 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.699656 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:38:30.699732 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.699663 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-kube-api-access-jgmxc" (OuterVolumeSpecName: "kube-api-access-jgmxc") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "kube-api-access-jgmxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:38:30.699809 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.699784 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-token" (OuterVolumeSpecName: "istio-token") pod "b391b3d0-0ebb-45f1-bcab-58669e6a0e16" (UID: "b391b3d0-0ebb-45f1-bcab-58669e6a0e16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:38:30.799514 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799474 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-credential-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799514 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799507 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-data\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799514 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799516 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-envoy\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799514 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799524 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgmxc\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-kube-api-access-jgmxc\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799790 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799537 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-podinfo\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799790 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799546 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-socket\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799790 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799553 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-istio-token\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:30.799790 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:30.799560 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b391b3d0-0ebb-45f1-bcab-58669e6a0e16-workload-certs\") on node \"ip-10-0-136-8.ec2.internal\" DevicePath \"\"" Jul 02 20:38:31.365669 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.365634 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717055-vmrpl_86e78d2e-7845-4987-9455-dd695576e39d/cleanup/0.log" Jul 02 20:38:31.371643 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.371609 2555 generic.go:356] "Generic (PLEG): container finished" podID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerID="9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e" exitCode=0 Jul 02 20:38:31.371813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.371656 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" Jul 02 20:38:31.371813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.371688 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" event={"ID":"b391b3d0-0ebb-45f1-bcab-58669e6a0e16","Type":"ContainerDied","Data":"9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e"} Jul 02 20:38:31.371813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.371752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr" event={"ID":"b391b3d0-0ebb-45f1-bcab-58669e6a0e16","Type":"ContainerDied","Data":"547c3eca4df32e100ad0d9ff15421e0ab50f03679747f28cd6d28b1f45bbad08"} Jul 02 20:38:31.371813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.371782 2555 scope.go:117] "RemoveContainer" containerID="9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e" Jul 02 20:38:31.381431 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.381408 2555 scope.go:117] "RemoveContainer" containerID="29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233" Jul 02 20:38:31.390172 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.390150 2555 scope.go:117] "RemoveContainer" containerID="9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e" Jul 02 20:38:31.390480 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:38:31.390455 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e\": container with ID starting with 9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e not found: ID does not exist" containerID="9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e" Jul 02 20:38:31.390544 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.390493 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e"} err="failed to get container status \"9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e\": rpc error: code = NotFound desc = could not find container \"9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e\": container with ID starting with 9b48c1fe0b25ca2a8fa369f2daeb43d61cc1614875aa697d10cc18bca9d4598e not found: ID does not exist" Jul 02 20:38:31.390544 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.390517 2555 scope.go:117] "RemoveContainer" containerID="29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233" Jul 02 20:38:31.390800 ip-10-0-136-8 kubenswrapper[2555]: E0702 20:38:31.390781 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233\": container with ID starting with 29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233 not found: ID does not exist" containerID="29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233" Jul 02 20:38:31.390863 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.390804 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233"} err="failed to get container status \"29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233\": rpc error: code = NotFound desc = could not find container \"29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233\": container with ID starting with 29e90a503d77b2c0b6a17690b46b664bf3d0040b223c6f6453b2dbff4e7e7233 not found: ID does not exist" Jul 02 20:38:31.394100 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.394078 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr"] Jul 02 20:38:31.398215 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.398196 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fd52f9-openshift-default-5b58d6f8c9-95tmr"] Jul 02 20:38:31.510057 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.510028 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717070-5n6qv_9037e1b5-f500-4822-bda0-2b5779466cd2/cleanup/0.log" Jul 02 20:38:31.873373 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:31.873341 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" path="/var/lib/kubelet/pods/b391b3d0-0ebb-45f1-bcab-58669e6a0e16/volumes" Jul 02 20:38:32.368219 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:32.368195 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c8797c58-k7mmx_58bf84af-8a7c-4a1d-8a5c-786eb4c0d926/copy-manifests/0.log" Jul 02 20:38:32.375387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:32.375360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c8797c58-k7mmx_58bf84af-8a7c-4a1d-8a5c-786eb4c0d926/manager/0.log" Jul 02 20:38:33.980829 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:33.980796 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fdcb7d8bb-khkv4_74a79e17-23d2-4bdc-a181-6ed7883235b8/authorino/0.log" Jul 02 20:38:34.395786 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:34.395757 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xvm75_ea60e9e6-8b9b-41cc-9159-8ad174309b79/kuadrant-console-plugin/0.log" Jul 02 20:38:34.657569 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:34.657496 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-brc6j_725de289-2c28-48da-b152-23b647861d86/manager/0.log" Jul 02 20:38:35.795494 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:35.795464 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7dc9b6d5-spcqx_2b7da129-c79f-4590-8941-893c28458af9/kube-auth-proxy/0.log" Jul 02 20:38:36.769623 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:36.769590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cp2qb_f7707a2f-b964-4c47-a1ba-5b257d60d1e6/main/0.log" Jul 02 20:38:42.357070 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.356983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:42.357571 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357308 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d6xfm/must-gather-v6hf5"] Jul 02 20:38:42.357665 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357652 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" Jul 02 20:38:42.357709 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357665 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" Jul 02 20:38:42.357709 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357676 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" Jul 02 20:38:42.357709 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357682 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" Jul 02 20:38:42.357709 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357698 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" Jul 02 20:38:42.357709 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357704 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357712 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0aaa7e-2c13-4802-8c5e-d490b50f910a" containerName="main" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357718 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0aaa7e-2c13-4802-8c5e-d490b50f910a" containerName="main" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357779 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357786 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0aaa7e-2c13-4802-8c5e-d490b50f910a" containerName="main" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357794 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357801 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357862 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" Jul 02 20:38:42.357902 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357868 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b391b3d0-0ebb-45f1-bcab-58669e6a0e16" containerName="istio-proxy" Jul 02 20:38:42.358177 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.357963 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4872333a-e6f0-408f-9a99-5e674ebd3ad1" containerName="istio-proxy" Jul 02 20:38:42.362345 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.362327 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.364914 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.364890 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d6xfm\"/\"openshift-service-ca.crt\"" Jul 02 20:38:42.365062 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.365000 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d6xfm\"/\"kube-root-ca.crt\"" Jul 02 20:38:42.365789 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.365769 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d6xfm\"/\"default-dockercfg-48tzv\"" Jul 02 20:38:42.369088 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.369068 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d6xfm/must-gather-v6hf5"] Jul 02 20:38:42.455285 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.455253 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" limit=1024 Jul 02 20:38:42.516127 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.516094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f5b62082-a00c-4aeb-bc6d-ecba8617ca4e-must-gather-output\") pod \"must-gather-v6hf5\" (UID: \"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e\") " pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.516312 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.516203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dghp\" (UniqueName: \"kubernetes.io/projected/f5b62082-a00c-4aeb-bc6d-ecba8617ca4e-kube-api-access-4dghp\") pod \"must-gather-v6hf5\" (UID: \"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e\") " pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.617634 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.617540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f5b62082-a00c-4aeb-bc6d-ecba8617ca4e-must-gather-output\") pod \"must-gather-v6hf5\" (UID: \"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e\") " pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.617634 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.617621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dghp\" (UniqueName: \"kubernetes.io/projected/f5b62082-a00c-4aeb-bc6d-ecba8617ca4e-kube-api-access-4dghp\") pod \"must-gather-v6hf5\" (UID: \"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e\") " pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.617928 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.617904 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f5b62082-a00c-4aeb-bc6d-ecba8617ca4e-must-gather-output\") pod \"must-gather-v6hf5\" (UID: \"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e\") " pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.625143 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.625118 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dghp\" (UniqueName: \"kubernetes.io/projected/f5b62082-a00c-4aeb-bc6d-ecba8617ca4e-kube-api-access-4dghp\") pod \"must-gather-v6hf5\" (UID: \"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e\") " pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.672371 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.672337 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d6xfm/must-gather-v6hf5" Jul 02 20:38:42.807640 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.807616 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d6xfm/must-gather-v6hf5"] Jul 02 20:38:42.809583 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:38:42.809553 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5b62082_a00c_4aeb_bc6d_ecba8617ca4e.slice/crio-8ed72e3c6afe9423e088251595a78d5fd502db350d89d008c5cee74a36976929 WatchSource:0}: Error finding container 8ed72e3c6afe9423e088251595a78d5fd502db350d89d008c5cee74a36976929: Status 404 returned error can't find the container with id 8ed72e3c6afe9423e088251595a78d5fd502db350d89d008c5cee74a36976929 Jul 02 20:38:42.811690 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:42.811673 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:38:43.433625 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:43.433591 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d6xfm/must-gather-v6hf5" event={"ID":"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e","Type":"ContainerStarted","Data":"8ed72e3c6afe9423e088251595a78d5fd502db350d89d008c5cee74a36976929"} Jul 02 20:38:44.443163 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:44.443113 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d6xfm/must-gather-v6hf5" event={"ID":"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e","Type":"ContainerStarted","Data":"10ff5043626dd58355cad8ca83c6a0e7abd94f68b4dd6ca4ca214c6d2db26788"} Jul 02 20:38:44.443665 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:44.443177 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d6xfm/must-gather-v6hf5" event={"ID":"f5b62082-a00c-4aeb-bc6d-ecba8617ca4e","Type":"ContainerStarted","Data":"f107a6c3587fcba4d2fe9667e5faab85d75976036eb3d66d4db1d11609db0df4"} Jul 02 20:38:44.463192 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:44.463138 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d6xfm/must-gather-v6hf5" podStartSLOduration=1.822256415 podStartE2EDuration="2.463122572s" totalImagesPullingTime="640.866157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:44.461097746 +0000 UTC m=+2519.191540153" watchObservedRunningTime="2026-07-02 20:38:44.463122572 +0000 UTC m=+2519.193564977" Jul 02 20:38:45.127969 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:45.127923 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ts6nm_d325dfc6-0226-40f2-91bd-6ec23f095948/global-pull-secret-syncer/0.log" Jul 02 20:38:45.180698 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:45.180644 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gjc8h_54df8714-3929-4d8e-ae6f-75e04f6f266a/konnectivity-agent/0.log" Jul 02 20:38:45.302065 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:45.302038 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-8.ec2.internal_2ca5057edadbcb38ff03c062e950e5d3/haproxy/0.log" Jul 02 20:38:50.570407 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:50.570099 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-fdcb7d8bb-khkv4_74a79e17-23d2-4bdc-a181-6ed7883235b8/authorino/0.log" Jul 02 20:38:50.659185 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:50.659150 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-xvm75_ea60e9e6-8b9b-41cc-9159-8ad174309b79/kuadrant-console-plugin/0.log" Jul 02 20:38:50.892313 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:50.890154 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-brc6j_725de289-2c28-48da-b152-23b647861d86/manager/0.log" Jul 02 20:38:52.665416 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.665317 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/alertmanager/0.log" Jul 02 20:38:52.706504 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.706469 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/config-reloader/0.log" Jul 02 20:38:52.731722 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.731692 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/kube-rbac-proxy-web/0.log" Jul 02 20:38:52.756165 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.756126 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/kube-rbac-proxy/0.log" Jul 02 20:38:52.780088 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.780035 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/kube-rbac-proxy-metric/0.log" Jul 02 20:38:52.807351 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.807323 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/prom-label-proxy/0.log" Jul 02 20:38:52.830151 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.830109 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_29caf4af-19e8-4eb1-824c-00ad75c8c8c8/init-config-reloader/0.log" Jul 02 20:38:52.907309 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.907265 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dqrrx_6d684c44-d41a-4dea-a330-217244b3e444/kube-state-metrics/0.log" Jul 02 20:38:52.929586 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.929479 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dqrrx_6d684c44-d41a-4dea-a330-217244b3e444/kube-rbac-proxy-main/0.log" Jul 02 20:38:52.952356 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.952329 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-dqrrx_6d684c44-d41a-4dea-a330-217244b3e444/kube-rbac-proxy-self/0.log" Jul 02 20:38:52.981487 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:52.981455 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7df9f6dcf4-8rxt6_932b8b9c-8ad5-4d09-aa86-09b8c39de330/metrics-server/0.log" Jul 02 20:38:53.009759 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.009723 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-z69gd_b5dce658-813b-49f5-9872-8a38155d9b13/monitoring-plugin/0.log" Jul 02 20:38:53.042386 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.042354 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2mh8_4ae9b380-de57-48ac-a8a9-3da847b1c75a/node-exporter/0.log" Jul 02 20:38:53.064561 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.064516 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2mh8_4ae9b380-de57-48ac-a8a9-3da847b1c75a/kube-rbac-proxy/0.log" Jul 02 20:38:53.088945 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.088290 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g2mh8_4ae9b380-de57-48ac-a8a9-3da847b1c75a/init-textfile/0.log" Jul 02 20:38:53.288782 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.288752 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frxgn_b4af67dd-880a-4265-ae74-25900e961689/kube-rbac-proxy-main/0.log" Jul 02 20:38:53.314948 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.314920 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frxgn_b4af67dd-880a-4265-ae74-25900e961689/kube-rbac-proxy-self/0.log" Jul 02 20:38:53.342126 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.342094 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frxgn_b4af67dd-880a-4265-ae74-25900e961689/openshift-state-metrics/0.log" Jul 02 20:38:53.382390 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.382363 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/prometheus/0.log" Jul 02 20:38:53.404691 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.404660 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/config-reloader/0.log" Jul 02 20:38:53.428573 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.428533 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/thanos-sidecar/0.log" Jul 02 20:38:53.450813 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.450783 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/kube-rbac-proxy-web/0.log" Jul 02 20:38:53.474962 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.474934 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/kube-rbac-proxy/0.log" Jul 02 20:38:53.502976 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.502949 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/kube-rbac-proxy-thanos/0.log" Jul 02 20:38:53.529722 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.529691 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f4c909a-0345-4009-a0dc-0c8644efacc1/init-config-reloader/0.log" Jul 02 20:38:53.560418 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.560334 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-x2z86_c69fba04-e867-40b6-a59e-0ef76343f44b/prometheus-operator/0.log" Jul 02 20:38:53.579998 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.579968 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-x2z86_c69fba04-e867-40b6-a59e-0ef76343f44b/kube-rbac-proxy/0.log" Jul 02 20:38:53.604919 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.604866 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-xbbzm_4b542383-fcad-4a85-a154-4674b5d074c1/prometheus-operator-admission-webhook/0.log" Jul 02 20:38:53.633856 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.633829 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55fcd48884-8r477_8cffb28b-64e8-463e-bf3f-9488aa4d236d/telemeter-client/0.log" Jul 02 20:38:53.656461 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.656425 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55fcd48884-8r477_8cffb28b-64e8-463e-bf3f-9488aa4d236d/reload/0.log" Jul 02 20:38:53.680154 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.680088 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55fcd48884-8r477_8cffb28b-64e8-463e-bf3f-9488aa4d236d/kube-rbac-proxy/0.log" Jul 02 20:38:53.728665 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.728636 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c54d855f-jj9jk_be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907/thanos-query/0.log" Jul 02 20:38:53.752131 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.752098 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c54d855f-jj9jk_be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907/kube-rbac-proxy-web/0.log" Jul 02 20:38:53.791625 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.791551 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c54d855f-jj9jk_be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907/kube-rbac-proxy/0.log" Jul 02 20:38:53.809596 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.809563 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c54d855f-jj9jk_be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907/prom-label-proxy/0.log" Jul 02 20:38:53.835467 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.835386 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c54d855f-jj9jk_be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907/kube-rbac-proxy-rules/0.log" Jul 02 20:38:53.857013 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:53.856983 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56c54d855f-jj9jk_be4a6dc5-1f6e-4e48-9ceb-61e09bdcf907/kube-rbac-proxy-metrics/0.log" Jul 02 20:38:55.499350 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.499304 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz"] Jul 02 20:38:55.507591 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.507553 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.513721 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.513679 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz"] Jul 02 20:38:55.563178 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.563142 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-lib-modules\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.563387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.563214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7dj5\" (UniqueName: \"kubernetes.io/projected/f31262f2-c6b2-4df5-9ca2-f96a227472ee-kube-api-access-l7dj5\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.563387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.563285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-sys\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.563387 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.563356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-proc\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.563621 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.563430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-podres\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664488 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664444 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-podres\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664682 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664499 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-lib-modules\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664682 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664549 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7dj5\" (UniqueName: \"kubernetes.io/projected/f31262f2-c6b2-4df5-9ca2-f96a227472ee-kube-api-access-l7dj5\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664682 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664611 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-sys\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664682 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664639 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-podres\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664950 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-lib-modules\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664950 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-sys\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664950 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664728 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-proc\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.664950 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.664798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f31262f2-c6b2-4df5-9ca2-f96a227472ee-proc\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.674093 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.674024 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7dj5\" (UniqueName: \"kubernetes.io/projected/f31262f2-c6b2-4df5-9ca2-f96a227472ee-kube-api-access-l7dj5\") pod \"perf-node-gather-daemonset-nvlfz\" (UID: \"f31262f2-c6b2-4df5-9ca2-f96a227472ee\") " pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:55.824834 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:55.824740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:56.005662 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:56.005625 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz"] Jul 02 20:38:56.008605 ip-10-0-136-8 kubenswrapper[2555]: W0702 20:38:56.008099 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf31262f2_c6b2_4df5_9ca2_f96a227472ee.slice/crio-045d457ba52414d4b6ffd53e022fc4ad560bb51ca878f539f7b3291eed9a08c7 WatchSource:0}: Error finding container 045d457ba52414d4b6ffd53e022fc4ad560bb51ca878f539f7b3291eed9a08c7: Status 404 returned error can't find the container with id 045d457ba52414d4b6ffd53e022fc4ad560bb51ca878f539f7b3291eed9a08c7 Jul 02 20:38:56.280271 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:56.280246 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b7b6f5887-jt5lw_271888b1-3ec6-426f-82ad-90cb7de35a18/console/0.log" Jul 02 20:38:56.552833 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:56.552793 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" event={"ID":"f31262f2-c6b2-4df5-9ca2-f96a227472ee","Type":"ContainerStarted","Data":"d8a0947571f955fa2bad638cd12c846d89866cd267da30be09f8ed6107d3cbdf"} Jul 02 20:38:56.553342 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:56.552861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" event={"ID":"f31262f2-c6b2-4df5-9ca2-f96a227472ee","Type":"ContainerStarted","Data":"045d457ba52414d4b6ffd53e022fc4ad560bb51ca878f539f7b3291eed9a08c7"} Jul 02 20:38:56.553342 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:56.552925 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:38:56.572221 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:56.572170 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" podStartSLOduration=1.572153046 podStartE2EDuration="1.572153046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:56.569956312 +0000 UTC m=+2531.300398722" watchObservedRunningTime="2026-07-02 20:38:56.572153046 +0000 UTC m=+2531.302595451" Jul 02 20:38:57.972954 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:57.972925 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mkx7d_824a8cc9-2568-42e8-9096-3e2479c6b970/dns/0.log" Jul 02 20:38:57.995227 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:57.995200 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mkx7d_824a8cc9-2568-42e8-9096-3e2479c6b970/kube-rbac-proxy/0.log" Jul 02 20:38:58.077330 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:58.077298 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2b2wp_2151aa60-2c27-44f9-827f-3ad2ecbdc6f7/dns-node-resolver/0.log" Jul 02 20:38:58.698802 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:58.698740 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mwr9d_0969172f-4528-4a90-8628-1121113343ff/node-ca/0.log" Jul 02 20:38:59.928015 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:38:59.927957 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7dc9b6d5-spcqx_2b7da129-c79f-4590-8941-893c28458af9/kube-auth-proxy/0.log" Jul 02 20:39:00.775334 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:00.775300 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-25nph_b4a4da98-f606-4357-b5bb-25c94a6fb4d1/serve-healthcheck-canary/0.log" Jul 02 20:39:01.418606 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:01.418578 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-spxl5_3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4/kube-rbac-proxy/0.log" Jul 02 20:39:01.440834 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:01.440803 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-spxl5_3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4/exporter/0.log" Jul 02 20:39:01.467692 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:01.467652 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-spxl5_3f7938cc-edd3-4e31-b7f5-00d0e2fb49b4/extractor/0.log" Jul 02 20:39:02.571913 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:02.571883 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d6xfm/perf-node-gather-daemonset-nvlfz" Jul 02 20:39:03.803553 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:03.803508 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717055-vmrpl_86e78d2e-7845-4987-9455-dd695576e39d/cleanup/0.log" Jul 02 20:39:03.829447 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:03.829416 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717070-5n6qv_9037e1b5-f500-4822-bda0-2b5779466cd2/cleanup/0.log" Jul 02 20:39:04.233804 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:04.233775 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c8797c58-k7mmx_58bf84af-8a7c-4a1d-8a5c-786eb4c0d926/manager/0.log" Jul 02 20:39:04.255263 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:04.255229 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66c8797c58-k7mmx_58bf84af-8a7c-4a1d-8a5c-786eb4c0d926/copy-manifests/0.log" Jul 02 20:39:05.881934 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:05.881840 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58965cb8bc-gxxs8_39574b68-e87b-4284-a24a-50415b00e49b/manager/0.log" Jul 02 20:39:06.306521 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:06.306494 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7dc9b6d5-spcqx_2b7da129-c79f-4590-8941-893c28458af9/kube-auth-proxy/0.log" Jul 02 20:39:07.842051 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:07.842022 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b7dc9b6d5-spcqx_2b7da129-c79f-4590-8941-893c28458af9/kube-auth-proxy/0.log" Jul 02 20:39:12.501333 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.501304 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/kube-multus-additional-cni-plugins/0.log" Jul 02 20:39:12.523064 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.523032 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/egress-router-binary-copy/0.log" Jul 02 20:39:12.546461 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.546426 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/cni-plugins/0.log" Jul 02 20:39:12.567861 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.567839 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/bond-cni-plugin/0.log" Jul 02 20:39:12.592301 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.592276 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/routeoverride-cni/0.log" Jul 02 20:39:12.613779 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.613753 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/whereabouts-cni-bincopy/0.log" Jul 02 20:39:12.635729 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.635704 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhj4r_a81c0c79-f53e-447f-a398-edacfb3dc77b/whereabouts-cni/0.log" Jul 02 20:39:12.925754 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.925727 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v87ct_5a4dc9d5-acf3-4e92-8724-3e44e45cd6bb/kube-multus/0.log" Jul 02 20:39:12.946364 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.946334 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bpw2q_6d335f2e-9978-4088-ad57-c429506e14e0/network-metrics-daemon/0.log" Jul 02 20:39:12.966192 ip-10-0-136-8 kubenswrapper[2555]: I0702 20:39:12.966156 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bpw2q_6d335f2e-9978-4088-ad57-c429506e14e0/kube-rbac-proxy/0.log"